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Description of Evaluation* Report Series 



The Comprehensive School Mathematics program (CSMP) is a program of CEMREL 
Inc., one of the national educational laboratories, and is funded by the National 
institute of Education. Its major purpose is. the development of curriculum 
materials for grades K-6. 

nn a ^ 1 ? nin ? 1 " Se P te, * e t« l? 73 -' "MP materials. began being used in Classrooms * 
actlffl l^ 15 ' ^ 9 \ n V n J 1n kind ergarten and first grade. The evaluation 
thTnrWv oI!i P a a ^ lleled . th ? d ?velopment and dissemination of materials so that 
the primary evaluation emphasis is now at the upper elementary grades. All 
activities have been conducted by a group within CEMREL which is independent of 

The evaluation of the program in this extended pilo/ trial is intended to be 
ItdTnt y C ?n P /tS S1Ve and i° Supply informat ion desired by a wide variety of 

and da lit .fjlS"! ra ?5°? the 1 reports in this series are reasonably non-technicaf 
and do not attempt to widely explore some of the related issues. ,0n the next oaae 
is given a list of reports through 1980. Below is given a list of reports Smpfeled 

* 

Evaluation Report: 8-B-l Sixth Grade Evaluation, Preliminary Study 

8-B-2 Evaluation of Revised Second Grade, MANS Blue Level 
* ' 8-B-3Jvaluat1on of Revised Third Grade, MANS Green Level 

8-B-4 Three Evaluations of Gifted Student Use 
8-C-l Preliminary Study of CSMP "Graduates" 



* ' Extended Pilot Trials of the ■ * 

Comprehensive School Mathematics Program ■ 

Evaluation Report Series. 

Evaluation Report 1-A-l Overview, Design and* Instrumentation 

(1974) l-A-2 External Review of CSMP Materials 
' l-A-3 Final Summary Report Year 1 

1-B-l -Mid- Year Test Data: CSMP First Grade Content 

l-B-2 End-of-Year Test Data: CSMP'First Grade Content 

l-B-3 End-of-Year Test Data: Standard First Grade Content 

1 -B-4 End-of-Year Test Data: CSMP Kindergarten Content 

l-F-5 Test Data on Some General Cognitive Skills 

1-B-& Summary Test Data: Detroit Schools 

1-C-l Teacher Training Report 

/l-C-2 Observations of CSMP First Grade Classes 

l-C-3 Mid-Year Data from Teacher Questionnaires 

1 -C-4 7 End-of-Year Data from Teacher Questionnaires 

, l-C-5 Interviews with CSMP Kindergarten Teachers 

1- C-6 v Analysis of Teacher Logs 

Evaluation Report 2-A-.1 Final- Summary Report Year 2 

(1975) 4 -4 2-B-l • Second Grade Test Data 

2- B-2 Readmini strati on of First .Grade Test Items 
, 2-B-3 Student Interviews 

2-C-l Teacher Questionnaire Data 

, 2-C-2* " Teacher Interviews, Second Grade 

2-C-3 Teacher Interviews, First Grade 

Evaluation Report 3-B-l Second and Third Grade Test Data Year 3 

. (1976) 3-C-l Teacher Questionnaire Data- Year 3 - 

Evaluation Report 4-A-l Fi\al Summary Report Year 4 

(1977) 4-B-l Standardized Test Data, Third Grade 1 

4-B-2 Mathematics Applied to Novel Situations ^MANS) Test Data 

4- B-3 Individually Administered Problems , Third Grade 
^-C-l Teacher Questionnaire Data, Third Grade 

Evaluation Report 5-B-l Fourth Grade. MANS Test Data 4 

(1978) 5-B-2 Individually Administered Problems, .Fourth Grade 

5- C-l Teacher Questionnaire and Interview "Data, Fourth Grade 

i 

^Evaluation* Report 6-B-l Comparative Test Data: Fourth Grade 

• (1979) 6-B-;2. Preliminary Test Data: Fifth Grade 

6- C-O Teacher Questionnaire Data: Grades 3-5 

Evaluation Report 7-B-l Fifth Grade Evaluation: Volume I,- Summary 

(1980) 7-B-2 Fifth Grade Evaluation: Volume II, Test Data 

7- B-3 Fifth Grade Evaluation: Volume III, Non-Test Data 
7-B-4 Re-evaluation of Second Grade, Revised MANS Tests 

, 7-B-5 Achievement of Former CSMP students at Fourth Grade 

/ 7-B-6 Student Achievement, Rapid Implementation Model 

Key to .Indexing 

Evaluation Reports are labelled m-X-n, 

where m is the year of the pilot study, with 1973-74 as Year 1. 

X is the type of data being reported where A is for overviews 

and summaries, B is for student outcomes and C is for other data 

n is the number within a given year and type of data. 
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Introduction 

In the spring of 1982 an Extended Pilot Test wilf be conducted in several 

» 

school districts which use CSMP through sixth grade. In preparation for this 
evaluation study, several MANS scales were -developed and tried out in the spring 
of 1981. In addition, several scales used the previous year in fifth grade were 
retested wfth'sixth graders in 1981. 

This report, then, is intended to serve two purposes: ♦* 

a) present preliminary evaluation data from two school districts regarding 
the .achievement of CSMP versus Non-CSMP sixth graders, 

b) present statistical data from the tryout of these scales. 

The MANS (Mathematical Applied to Novel Situations) Tests are short scales, 
'most of which were developed especially to assess wh'at are thought to be some 
of the underlying thinking skills emphasized in CSMP. ThVscales are administered 
by a tester who follows a standardized script including sample problems for each 
scale. Then the students do the test items in that scale and the processis 
repeated for the next scale. The scales do not contain any of the special voca- 
bulary or techniques of the CSMP program and most'of them are built around mathe- 
matical situations that are unfamilar to both CSMP and Non-CSMP students.. Hence, 
they tend to be difficult tests- with a problem sol ving orientation. 

In order to reduce testing time, frequent use is made of item sampling, in 
which half the .students in a class do one set of items of a test, while the other 
half do another. In some teases, entire scales are sampled, i-.e. , different halves 
.of the class do entirely different scales. 



An intensive pilot test review procedure is used in developing MANS Scales: 
CSHP evaluation Report 4-B-2 conta-ins a detailed description of this process. 
Previous scales are often reused and new ones added. 

Each of the next two chapters summarizes the data from a district in which 
CSMP classes were compared with" Non-CSMP classes,. Site A, whose results are 
described in the next chapter, had mostly students of high ability 'level ; many 
of the scales-used in Site A were being pilot tested for the first time. Site B, 
whose results are described in the chapter after next, had mostly students of 
lower ability, most of the scales used in Site B had been administered in fifth grade 
so that the present administration of scales provided a CSMP-Non-CSMP comparison 
both at fifth grade, and a year later in sixth grade. Tests were also administered 
in a third site, Site C. These results are not reported in a separate chapter 
since they are not concerned with the usual CSMP -Won- CSMP comparison. Rather, 
one group received instruction on materials similar to CSMP for one day per 
week for about 14 weeks. However, the data from Site C are included in Appendix 
A where the scale and item statistics are described, since many of 'the scales 
were new and their use in Site C constituted an excellent pilot trial of the 
scales. 



/. Preliminary Evaluation, Site A 

if 

Site A is an upper middle class suburb of a large Midwestern city. The 
district began using CSMP about eight years ago; in another year or two all K-6 
classes will be using CSMP. 



There were 6 sixth grade CSMP classes from two schools. Six Non-CSMP classes, 

from three schools, were selected to serve as comparison classes. The schools 

i 

and classes were known to be of similar academic ability and this was confirmed 
by reading scores of the participating students, as will be shown below. The 
testing required two periods of about 50 minutes for each cfass, and was con- 
ducted b,y a specially trained tester in May. 



Most of the students had participated in a similar comparison in fifth grade 
in the previous year. At that time a random half of a reading comprehension test, 
from the Comprehensive Test of Basic Skills, was also administered to each student. 
These scores were retained and used as a covariate in the present study. The mean 
reading score across the six CSMP classes was identical to one decimal place to 
the mean across the six jion-CSMP classes. The mean score was 20.0, -which corresponded 
to a percentile rank, on national fifth grade student norms, of between 70 and 80. 

« 

Based on students who were tested this year and who also had reading scores 
from last year, mean scores for each class were computed for each MANS scale and 
correspondingly for the reading test- An Analysis of Covariance procedure was 
then used on 'the class means, using mean class reading score as a covariate. 



For each of the 27 individual scales , the results of these analyses are presented 
in "Appendix A (along wtth results from the other two sites). These results include 
among other things, a listing of the items in the scale, percent correct for each 
item, graphs of class means and thfe covariate data. 



The 27 scales were grouped into eight categories according to the content of 
the scale. The results are shown in Table 1: a description of the category, the 
mean scores across classes,, and the p-value of the Analysis of Covariance t-test 
(i.e., the probability of a difference in mean scores as large as occurred happening 
by chance. If the p-value is less than .05— a one- in- twenty probability of 
happening by chance— the difference is sometimes said to be statistically significant.) 
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Table 1 





Adjusted Mean Scores 1 




* 


• 


on MANS Categories 

* * * 




• 


.v. 


Category^ 


CSMP 

(n=6) 


Non-CSMP 

' ' (n=6) 


• 

p-Value 3 


r 


(A) Pre-Alqebra (5 scales. 54 Items) * 

(Includes five types of scales, each 
of which requires students to solve* 
simple equations given operators and/or 
* unknown qvanttttes) , 


28.5 


25.2 


- ' f 

<.02 - 


• 


(C) Computation (1 scale. 9 Items) 

(Requires exact answers to calculations 
amenable to non -algorithmic solution) 


5:5 


4.6 


<.10 


• 


(L) Logic (6 scales, 42 Items) 

^Requires the solution of several types 
of logic problems: Implication; Venn 
diagrams, order relations, and others) 


22.8 


2.3.0 






• (N) Other Number Systems f8 scales, fil itmm^) 
(Kequires computation with, or applica- 
tions of, negative numbers, fractions, 
and decimals) 


43.4 


> 

37.7 


<.02 




) (P) Probability (2 scales. 13. 12 it***) 
(Requires the determination of the 
likelihood of given orderly events) 


11.5 


lO.l 




• 


(R) Number? Relationships (2 scale*. ?7 it***} 
(Kequlres finding or applyirtg a given 
pattern in sets of numbers)- 


15.5 


i a n 


^.01 




(U) Elucidation i'l scale. 4 items) 

(Requires producing many correct 
answers to ar given probVem) 


,29.7 


21.0 


<.01 


• 


(W) Word Problems (2 scales. 11 items) 
(Kequlres the solution of problems 
Involving simple computation as well 
as logical thinking) 


4 

5.7 


5.5 


% 

i" 




TOTAL MANS SCORE 


162.1 


<* 

140.4 


<.01 



Adjusted for differences In ability among classes, based on 1980 reading scores 
2 See Appendix A for a description and summary statistics of each of the individual scales. 
3 A dash ( — ) indicates the p-value was not less than .20. 
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There were four categories on which CSMP classes had significantly higher 
scores. One of these, Pre r Algebra, was a newly developed MANS category; the 
other three are categories on which CSMP students have always performed very 
wall i.e., Other Number Systems , Number Relationships, and Elucidation. 

The mean total scores were 162' for CSMP. classes versus 140 for Non-CSHP 
classes, a difference which is significant at the .01 level. In Figure 1, below, 
the Total MANS score for each class is plotted against the mean reading score 
for that class. 

. * Again these means are based only on students for whom a 1980 reading score was 
available. A regression line has been drawn to indicate the best linear prediction 
of MANS score for given reading scores; its upward slope indicates that classes 

with higher reading scores would be expected to have higher MANS scores. * 

• \ 

\ 





, Logic (L) 




Other Number Systems (N) 
(Fract ions and Decimals 

L 




, • Figure 2, Graphs of Class Means by Category 
X = CSMP class, • = Non-CSMP class 
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A secondary analysis used the mean MANS scores for each class based' on 
an students, regardless of whether or not a 1980 reading score existed for each 
student. An Analysis of Variance, i.e., a comparison of the CSMP versus Nor.-CSMP 
class means, was then performed for each MANS scales without regard to class 
ability level.; The analysis yielded results even more favorable to CSMP but are 
not reported here. 
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Preliminary Evaluation, Site B 

Site B is a large Southern city. CSMP was in its third year of use; con- 
sequently the CSMP students had used CSMP in grades 4-6, but not previously. 

The comparison in Site B was a follow-up to an evaluation study conducted 
the previous year when the students were fifth graders. At that time, five CSMP 
classes were compared with three Non-CSMP classes. 

In the present study there were really three groups of classes: 

a) three classes yhose students had studied CSMP in grades 4-6, 

b) two classes, whose students had studied CSMP in grades 4 and 5, £ut 
a more traditional curriculum in cjrade 6, and 

c) -two classes, whose students had studied a traditional curriculum 

throughout. 4 

, A total of 34 scales were administered," 26 of which were repeated from 
last year's testing and 8 of which were new. The tests were administered by a 
trained tester and required three periods of about 45 minutes. As in Site A, 
scores from a random half of the CTBS Reading Comprehension Test from the previous 
year were available for some students. Table 2 shows the available covariate data. 
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Table 2 

Mean Scores and' Number of Students Tested, 
CTBS, Reading Comprehension from May," 1980, Site B 



» 


Number Tested 


Number Tested 
Heading, 1980 


Mean Reading 
(Kaw bcore; 


"Mean Reading 
Across Classes 


CSMP Classes: 1 
2 
3 


23 
28 
26 


17 
23 
19 


13.8 
13.4 
15.2 


14.1 


Former CSMP 

Classes: 1 
2 


24 # 

28 


14 
17 


15.6 
14.1 


14.9 


Non-CSMP 

Classes: 1 
2 


25 
28 


23 
12 


16.3 
14.6 


15.5 

— . 



Thus based on these data (about 2/3 of the students), the CSMP classes were 
a little lower in ability, as measured by reading scores, than the other two 
groups of students. The overall mean reading score in Site'B, about 15, corresponds 
to a*p^rcentile rank on national student norms of between 30 and 40. 

Comparison of class means, however, was based on all students in the class 
(i.e. regardless of whether or not-'they had 198Q Reading scores). Mean scores ' 
on the various MANS scales were computed for each class and then the 3 CSMP 
classes were compared with the other 4, classes (which were lumped together 
as Non-CSMP) using an Analysis of Variance procedure on the class means. 

Table 3 shows the mean scores in the various MANS categories. 
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Table 3 

Mean Scores on MANS Categories, Site B 



Scale Category 1 


Number of 


Total Number 


Mei 


n Scores 


2 

p-value 


Scales 


of Items 


CSMP (n-3] 


Non-CSMP (n=4) 


(if <-10) 


1 ' Computation 

(Mental arithmetic requiring 
exact answers to calculations 
amenable to flon-algorlthnric 
solution) 

* 


4 


31 


17.2 


13.8 

i * 

i 


< .14 


Estimation 
(For a giyen computation 
problem rapidly stlect'the 

best 0/ three on^^Hhl* iwtLMn* 
— *» w vim ^uaiioic answers, 

nont of which 1s exactly right) 


4 


• 24 


15-1 


X 

1 


<.14 


Other Number Systems 
(uwputation and applications 
of fractions and decimals) 


9 


70 


40.0 


31.4 


<.08 


Logic 

(Requires the solution of several 
types of logic problems: Implica- 
tion, Venn diagrams, order rela- 
tions, and others) 


4 


33 


14.7 


14.2 * 




Oraanlzlnq Data 
(Organize and Interpet data . 
with graphs, charts, tables, 
etc. ) 4 


1 


10 


5.5 


4.7 ' . 


< .03 


\ 

Probability 
("Compare and estimate the 
probability of the occurrence 
of various events 1n probabilistic 
situations) 


2 


' 30 


12.8 


12.1 • 

\ 




Number Relations 
(Hnding and applying patterns 
to given sets of numbers 


4 


41 


23.0 


18.8 


<.04 


Elucidation 
(Produces as many possible correct 
answer* to a given set of conditions) 


2 


34 


19.0 


13.7 

' f 


<.04 


word Problem./ 
(Require* the solution qf two to. 
three stage word problems Involving 
low- ltvtl compuUtlon) 


3 


17 


8.0 


6.2 , 


<.01 


TOTAL MANS ' 


31 


290 • 


154.7 


127.2 


<.07 



rem P for d e«h s f ° a r ]e a descr1pt1on of " ch Individual scale (Including sample Items and the 



t p „e va ;" a i f rw« a ^ i !ess f sirs. 1 -™ w1th 5 de9rees of fn * dom - A dasn ( -> indicates 
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With only 7 classes, and 5 degrees of freedom in the analysis, very large 
differences are required to achieve statistical significance. Nevertheless the 
CSMP classes did score significantly higher on 4 categories and almost significantly 
higher on the total. In fact, on all categories except Logic and Probability 
there was a considerable CSMP advantage of at least 15%. • L 



The CSMP advantage is even more compelling when one considers the fact that 
the available reading scores suggest the CSMP classes were probably slightly lower 
in ability^to begin with. 



The graphs -of the class means are shown in Figure 3. These means were 
derived differently; they were based on only those students in each class for 
whom a readirvg score was available, an average of about 2/3 of the students in 
each class. 

Total 
MANS 




Reading 
Comprehension 



Figure 3, Graph of sixth g^de class me 3ns, Total MANS, Site B 
x = CSMP Class, (x) = Former CSMP Class, • = Non-CSMP Class 



It can be seen that there is a clear relationship between the amount of CSMP 
instruction and Total MANS score: Relative to the regression line, which is the 
best predictor of MANS for given class ability level (as measured by reading 
scores), the 3 CSMP classes Ijad the highest scores (furthest above thk line) 
followed by the 2 "Former-CSMP" classes followed by the 2 Non-CSMP classes 
(furthest below the line). % 

t * 

The data were similar to last year's results, although comparisons are difficult 
to make^ because 2 of the classes which were treated as Non-C^MP this year were part 
of the CSMP group last yearr^But generally, CSMP' classes continued to have a large 
advantage on Word Problems, Fractions and Decimals (Other Number Systems), Elucidation 
''and Number Relationships. The advantage they had in Probability in fifth grade 
disappeared this year. The disadvantage CSMP classes had in the Estimation scales 

* c 

. last year also disappeared. 
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Introduction to Appendix A 



This Appendix describes statistics frt^the administration of various MANS 
scales at thnee sites. Some "of the scales were new, some were. repeated from 
5th grades and some were revisions of previous scales. Altogether, about 60 
scales were administered^ 45 pf which were unique to one site and the other 15 
common to two or more sites. 



The three sites are described briefly be! 



ow. 





Site A 


Site C 


Site B 


Location 


Suburban St. Louis 


Urban Midwest 


Urban South 


CSMP/Non-CSMP Classes 


6/6 


6/6 


3/4 


Ability Level 


High 


4 

Below Average 


Below Average 


. Curriculum Studied by "CSMP" 


Regular 6th 


TOPS 1 


Part 5th, Part 6th 


Type of MANS Scale 

Percentage of students 
participating in similar 
* testing the previous year 


Mostly new 

70% 


Some new/ 
some revised 

None 


Mostly repeats 

80% 



The data will be presented scale-by-scale^ith scales grouped by categories. 
Each category is preceded by an advanced organizing page. Each scale presentation 
consists of a left and a right hand page, whose format is described below. 



IPS I s I ? ne - da y-Per week supplement, Intended to teach problem solving and using various 
smw S l^ll l J St yea r wa , s the f1rst year of a two-year project, funded.by Title II Basic 
fs con S ?d.rPd ^n^nVWl 0 "' StudentS had onl * ab0 " t 4 "™ ths ° f TOPS; hence Site C 
y'd f"ren?es * P ^ f ° r tCSt deve l°P<*nt rather than an indication of CSMP-Non-CSMP 
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Left Hand Pages 

The left hand page's will present all the items in a scale, together with 
the percent correct /or CSMP and Non-CSMP students and the r-bi serial correlation 
between item and t\)e total scale score, corrected for item inclusion in the scale. 
(For convenience, the TOPS' classes in Site C will be referred to as "CSMP".) At 
the bottom of the page will be given the number of students on whom the above 
data'is based, the KR20 reliability coefficient for each group, the mean reading, 
score, and the correlation between this reading score and the scale score across 
students at the site. 



The reading scores are the same in Sites A and B,' namely the Reading Comprehension 
test from the CTBS administered in the spring of'l980 as part of the fifth grade N 
MANS testing. * At Site C, a previous reacting score was available for almost all 
students, but it was from a different test, the Reading Comprehension Test of the • 
XAT. For convenience, mean scores (or later, mean class scores) from this test 
have been converted, on an equi-percentile basis, to raw scores on the CTBS, thus 
yielding roughly comparable scores from site to -site. At all sites, some of the 
students were not present for the respective reading tests, but the item analysis • 
data on this page (as well as the frequency distributions on the next page) are 
based on al 1 students regardless of previous testing. 

Where more than one -entry appears, it is usually the separate entries for 
the various sites that are given, in alphabetical order. 
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Right Hand Pages 

Five k'inds of information may be presented: • 

1. Sample page. Where it has not been possible to show, on the left hand 

s 

page, the full student'page of a scale, a reduced sample page will be shown to 
illustrate the examples used with the students; the' page layout, the format of 
the items, etc. 

2. Frequency distribution. A frequency distribution of scores on She scale 
is given for each group of students, i.e., the percentage of students attaining a 
given score or score range on the scale. These data are based on all students 
whether or not they had a reading score. 

3. A graph of class means will be given in the following format: 

Scale Score 

~% 

^ etc. ' 



O ^ 
A 

□ A 



^ - Reading Score 

where: solid figures represent CSMP classes, empty figures Non-CSMP 
and ■,□ = Site A; #,0 = Site B; and A, A = site C 

The data points were graphed using mean raw scores for "each class and were 
based only on students also present for the reading test. The vertical axis will " 
change from scale to. scale, and will therefore be labelled numerically. However, 
the horizontal 4xis will be the same from graph to graph and will be essentially 
unlabel led except for the three arrows which indicate approximately the corresponding 
reading scores for the 25th, 50th and 75th percentiles based on national norms for 
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tndi vidua! students, thereby giving a rough indication of the general ability level 
of the class. Most graphs will show "data from only one site and hence .will have only 
one kind of geometric symbol (i.e., square, circle, or triangle). 

In one corner of the graph is given the adjusted means, CSMP versus Non-CSMP, 
and the p-value of the t->test from the Analysis ^of Covariance data, with reading 
score as covariate and classes as units of analysis. If the scale was used in more 
than one site, the data are given separately for each. On most graphs, a regression • 
line has beert drawn to show the best linear predictor of MANS score for given reading 
scores. 

4. Means by ability levels. At each site, students were grouped according 

to the quartile thei r' readi ng score would have placed them in, using national norms. 
For each quartile grouping of students, a mean score on the scale was calculated 
and is given. Alsp given for each grouping i*s the t-statistic of the Analysis of 
Covariance test comparing CSMP and Non-CSMP students. The same procedure was used 
for all students combined who had reading scores; i.e., a mean calculated for CSMP and 
Non-CSMP students and a t-statistic produced. As a rule of thumb, a t-statistic c 
larger than 2.0 is significant at the .05 level if one uses the liberal model of 
students, rather than classes, <as the units of analysis. Means by ability levels . 
are not given for Site A because there were too few students in the lower quartiles. 
0ccasiona>ly , they are also not given at other sites if there were too few students 
in a grouping ( < 15). This means the overall mean and t-statistic shown may seem 
anomalous since they represent more quartiles than are shown in the table. 

5. Comments. Comments may explain directions, point out important results 
or questionable items, suggest revisions, etc. 



A: Pre-Algebra Category 

This is a new category. Five scales were administered at" Site A only: 

Al - Algebraic Symbols page A6 

A2 - Solving Equations \ . /\8 

> 

A3 - Summation Operator -,A10 

A4 - Multiplying Summations A12 

A5 - Functions; . . '. A14 » 




A5 



ERIC 



(A1) Algebraic Symbols, Site A 



ERIC 



Test Items 



In thtst problem, letters stand for nunbers. 

^/Samples: 2« mans 2 tines i. If « • 6, 2i ■ 2x6 - 12. 

3bc neans 3 tines b tines c. If b ■ 2 and c ■ 5 t 3bc ■ 3x2x5 • 30. 

Problems: 

*» 

If c ■ 4 and d"« 3, then 5cd ■ ' 



If c ■ 2, f • 2 end 9 ■ 3, then 4efg 
If y^- j, then 14y ■ 



B/Samples: S 2 oeins 5 tines 5. So 5 2 ■ 5x5 ■ 25. 

4 * 

d aeans d tines d tines d times d. » 

c 3 neahs c tines c tints c. If c * 2, c 3 ■ 2x2x2 • 8. 

Probl ens : 
6 2 - * 



If d ■ 8. then d' • 



If c • 2 and b ■ 3, then i J b 
If c ■ i; then c 5 ■ 



If d ■ 5, then 2d' • 



If a ■ 3 and b • 2, then 4ab' 



If c ■ 5 and a ■ 6, then c* - 3a 
If a - 85, then a 7 * a 6 ■ 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



A6 

27 • 



Percent 
Correct 
C N 



(*3 



S3 
f3 



• ?7 



a* 

s3 



Lt*> 
SI 



07 
SI*- 



S3 
3o 



sy 

j< 
so 



Cf2 



Biseri&l 
C N 



.-7<> 



,9a 

,9Q 
.70 



7UZ> 
,39 



•32 



.70 
, f/ 



, -73 



,ut> 
.33 



,1*0 

>32 



2? 



(Al) Algebraic Symbols 
(Student page is shown on the facing page.) 



Snph of Cltst ferns 



Frequency Distribution 




Score 


% of students 




csm 




O 




I* 


I 


*3 








32. 


7 -If 


* «f 7 


50 


, IK 


Off 


oo 







Adjusted Means 






Site 


CSMP 


Non-CSMP 


p-v»1ue 




A 


5.9 


5.3 





Comments: 



-After the sixth item, the percent correct dropped abruptly, probably because 
students were being asked for the first time to simultaneously use both of 
the conventions defined in the two sample sets. For example, 2d 2 (where d = 5) 
elicited many 2 x 5 = ,10 answers-. 
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(A2) Solving Equations, Site A 



Test Items 



Percent 
Correct 
C . N 



Bi serial 
C N 



In thtst problems, litters sund for nurttrt. 

Samples: t ♦ 7 » 12, so • » S 
3xb-33 sob» II 
(4 x c) ♦ 1 » 41, so c » 10 



You do the rest: 



d * 13 » 14, so d ■ 
e • 4 » 5, so e ■ 
6 x f • 12, so f • 



9 4** ■ 8» so g • 

(7 x h) ♦ 1 • 15, 'so h ■ 
(3 x 1) - 6 ■ 15, so 1 - 



(J x J) ♦ 1 ■ 26, so J ■ 

k ♦ 2 ♦ k ♦ 1 » 11, to k » 

(3 x n) x 2 ■ 16, so m ■ 

(n ♦ 1) -f 3 • 6, so n ■ 



p ♦ p ♦ q « 7, so wh*t could p be tftd q be? p • 



*nd q 



97 

92 
97 



76 
9? 



*7 

*79 



Number of solutions correct 
^ 0 

1 
z 

3 or 4 
S or S 
wort than t 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 
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Ob 


Ob 
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JA0 





91 

9? 



/.</&> 
/•// 



0>A 



7TS~ 

.71 



Ces- 
V9 



A.o¥ 

/■06 

.1* 



AAZ 



A oo 



2 U J* 



(A2) Solving Equations 
(Student page is shown on the facing page.) 



Frequency Distribution 



6nph of CI us Hftns 




Score 


% of students 








0 

I 


03 

00 


08 


U 




20 


l-\o 




70 



(excluding last problem) 



Site 


Adjusted Me ins 


p-vilue 


CSMP 


Non-CSMP 


A 


8.7 


7.4 


.01 



Comments: 



-Although the CSMP advantage is clear and consistent across items, both arouos did 
wisher 78°" *" ° f Pr ° b1emS; 6V6n f ° r N ° n - CSMP the ^er^'percen? cTrreci 

-The scale vyas verj/ homogeneous ; note the high biserial coefficients which conceptually 
should not exceed 1.0. 
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(A3) Summation Operator, Site A 



test items. \oee racing page.) 


Percent 
• «Correct 
C N 


Bi serial 
C N 


Common to both Form A and B: * « — - 


w. 






.0% 


" = □ 

SS + SS --DS 


70 




;67 


.37 


Form A: 






,8/ 




m -sss - □ 




OS 






582 r 232 = S3 + 


A3 


06? 




. 79 


+ EE --2S2 - EC 

■ 




// 


.93 




* 

Form B: r 




AT 


.(,<> 




EE +• S3 .- DC + □ 






.79 




- • '+ 2SS - S3 - □ 




tt 


.Uo 


,S9 


m +.ss -sss -□ 

1 


/I 


/</ 

- 


>'7 


>'9 


Number of Students 
KR20 Reliability 
Mean Reading Score 


.(el 


I3PI 
.hi 






£0-0 








Correlation: Scale and Reading 


• 01 







3 X A1 ° 



(A3) Summatjon Operator 







Facts 1^(25 1s 4 short "* y of writin 9 2 


♦3*4+5*6 


So 5*6*7*8canbe written 




- j2)(S = □ +. 


□ + □ 


6 + 7 + 8 + 9 ■ {JC, 




as - sc 





Frequency Distribution 



Score 


% of students 


0 


csr\p 




F»<n k a 


** fe - 


06 13 






W : si 

04 


SZ S3 

It 6^ 



Srtph of Class Mttns 




Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


A 


2.6 


2.4 


.30 



Comments: 



-This scale was very difficult. Although many students could do the samples and 
some of the early items, the percent correct dropped precipitously when the r ight 

hand side of the equation contained something more complicated than I 1 or Tjh, 

(i.e., if the "brute force" method did not apply). About a third of the students 
got no more than one item correct. 

-The sample items and the first few items may have increased too abruptly in 
complexity. . 

-There was virtually no relationship between this scale and vocabulary. J 



All 



(A4) Multiplying Summations, Site, A 



a Test Items (See facing page.) 



Percent 
Correct 
C N 



Bi serial 
C N 



1 I 1 



9o 



3V 



ass - E^TTy'Q 
51 -ES =3X,0 +22 



/3 



OP 



1 +3+5+7*9 



L 



0^ 



7? 



.*7 



'7 



3? 



07 



/9 



.fa 



(si 



06' 



57 



OS 



S2 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



,0>o 
do-£> 



Ho>o 



ERIC 
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(A4) Multiplying Summations 



Fact 



Sampl e 



□ 



Frequency Distribution 



Graph of CI us Hi vis 




Score 


% of students 






Mw-CSMf 


0 






I 


02 


a 


2-3 








61 




i 


0* 


02 



I Site 


Adjusted Hetns 


p-vilue 


CSMP 


Non-CSMP 


I A 


1.5 


1.3 


.20 , 



"SUB*. 



Comments: } 



-This scale, like A3, was very difficult. Although the items formed logical progressions, 
S2 d i ffl .^ u1t y level from the ^>st to second item was evidently too great 

The right hand side of the second item might better have 'been 
i.e., part of the information given. 



-The frequency distribution shows the inclusion of students' performance on the 
sample item as well. v * 
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(A5) Functions, Site A 



9 

ERIC 



Test Items (See facing page.) ' . 


Percent 
Correct 
C N 


Bi serial 
C N 


i 


J 


f 1 " * > 










-79 


, 


• 










Fa 
7? 


,7(p 
.« 


.7? 
.77 






•t )• 




f/ 




■ ?r 




U 










a-/ 
3 7 


, so 

i CP 


to** 














. 77 




XI )• 


o 








,70 


m 


Start with 


End up with 












i 


do end then -) 










.73 




















o 

f r 


do *[J and then 








•3 / 


* * f 
























do ""C" wd thtn "*"| 




- 


'3V 








* 

O ft 


do twice 






£7 






/ 7V 
















. *7 


X 

o o 


do (j n1nt tlaes 








3 3 


. 7/ 


X 
0 0 


do twice. 












"2 "7 


















X 
0 • 


do nine tlws 






(><-/ 




,L>i 


















Number of Students 








'30. 






KR20 Reliability 
Mean Reading Score 








*r 

26.0 






Correlation: Scale and Reading 
1 9— 




•33 
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(A5) Functions 



Things, can be changed with a H 

1. ^ changes f 'o ^ We show this change by saying: ^M- 
* 2./ "^changes A to > We say: "^'(A 1 ) = > 

Things cm bt changed with § 
JJ 1. changes 5>* to 'oo Wt show this change by laying: ~G^*o^ 



X 

O o 



r % 2. *\j changes T » T to We sty ^T*) - *** 



3. 



Also 



AAA 
S S 



TP Sarnie 1. 



Start with 
x 

go 



End up with 



and thtn 



changes ©♦ to • 



XX x 
changts o to o x 



Frequency Distribution 



Score 


% of students 




CSM 




O 






I 


0| 


oo ' 


2-7 














oi 




IS 




05" - 



Craph of Class teens 



Comments : 




Site 


Adjusted Means 


p- value 


CSMP 


Noo-CSMP 


A 


9.5 


8.6 


.20 



-Students seem to be able to understand the heavily symbolic directions. 

-The ^ (essentially a rotation) was done better than theX • 

-CSMP students had a larger advantage on set III, where composite functions were 
employed, than in the first two sets. 
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C: Computation Category / 

• * 

fcAt each site, a set of mental arithmetic items in the usual format was 
administered. Although the number, and difficulty, of items varied from site 
to site, and in Site B the items happened to be aggregated into four scales 
rather than one, there were many items common to different sites. Site B 
was simply a repetition of scales used last year; the other sites were revisions 
of this set of items. In all cases, students were not allowed to do "scratch work" 

CI - Mental Arithmetic (Site C) page A18 

C2 - Mental Arithmetic (Site A) A20 

C3 - Mental Arithmetic, Addition (Site B . . . A22 

C4 - Mental Arithmetic, Subtraction (Site B) . A24 



4f 

C5-- Mental Arithmetic, Multiplication (SiteB)A26 
C6 - Mental Arithmetic, Division (Site B). . . A28 



ERIC 



A17 



3, 



(CI) Mental Arithmetic, Site t 

/«.--- Multiplication/Division 



Test Items 



Percent 
Correct 
C N 



81 serial 
C N 



Form A,' Multiplication 



3 1 125 = 1 1 



too 



12 x 500 



to 



U • 273 = 3.0Q3 
30 x 20 x 5 « | | 



7 x 



| | x 250 = 500 

CD "» 

25 x 32 ss aoo 

26 x 32 - { j 

12 x 500 a f j " 



2V 



33 



Form B, Division 



700 Divide by 10 = | | 

210 Olvldtd by 3 = | [ 
1,200 Olvldtd by j j = 4 



33 



3.600 Divided by 15 = 2*0 
3.115 Olvldtd by IS S | | 
524 Olvidtd by 524 a | [ 



500 Olvldtd 



»"l 1 



100 Divided by 



= 200 



' 3*0 0<v1dtd , by M = I I 
1.200 Olvldtd by 30 - 4b 



3/ 
/9 



1,200 Olvldtd by 15 * 1 

496 Olvldtd by 



= 498 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



Form A 
Form B 



91 

/jr.? 



,V9 



/3f 



7ST 



'37 



34 
26 



/9 



773T 
-37 



37 



3S~ 



.£-7 



4/ 
,2? 



V7 



3$- 



.6* 



^'7 



• 3? 



.or 
.22 



TvT 
.9*- 



. 73 



.s9 
>*9 



.ti 



</9 
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(CI) Mental Arithmetic Multiplication/Division 



Frequency Distribution 



Grtph of C1tSS IfeiftS 




Score 


% of students 






NomCSMP 


0 
1 


il 13 


os.t* 

2.8 o9 


a-* 




38 46 


'5-8 


n n 


*>,Z1 


°i 


ol 0| 


08 OH 


10 




61 00 



feans by Ability Ltvel 



1 


2 


3 


4 


An 






V./ 










3.3 








• / 




/<? 


/.3 



Comments : 



-It should be recalled in Site C, "CSMP" students had studied only parts of CSMP - 
•*^and for only about 15 lessons. ^ 

-Students were not allowed, to do rough work; they were to figure the answer out in 
their heads. 

-IM general the performance of both groups was surprisingly poor. For example, 
only about half the students were able to do 700 divided by 10 . 

-Especially difficult for these students were the "two part" items such as 
11-x 273 = 3,003 
22 x 273 = r| 
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(CZ) Mental Arithmetic, Site A 
Multiplication 



Test Items 


Percent 
Correct 
C N 


Biserial 
' C N 












I * us • [ ] 


Sb 




,7? 


,</? 


Form A i 1 

J j x 30 " tOO 


0><8 




»30 


7 x ( ] • **> 


5?/ 


79 


7*/ 




1 12 i §00 ■ j | 


03 


#7 




.<// 


| 30 x 20 x 5 • 




! 


O if 


. V? 




11 x 273 ■ 

12 x 273 * | 


3.003 

I 




6~Cp 






25 x 32 • 800 

26 x 32 • f | 


(Pi 




it 


- VC*f 


(8 x 29) + (2 x 29) ■ 


i 




35 


. 73 




101 x * • 


1 




37 


jOO 


7 










Form B 

500 + 2 • 












I 1 




V9 


,82 


, 7£ 


360 + fO ■ 


I 1 


Oo 








eoo 4 [ J-200 


in 


Or 






i i*' 


• 30 






-7/ 




1200 + 4 ■ 






Os 






3.600 + 15 • 


240 










' 3.115 + 15 - 


1 i 


</</ 


30 




•7* 


1 .200 * 30 • 
1.200 -f 15 ■ 


40 

n 


VQ 


3z~ 


J 




(M x 25) + 12 ■ 


a 




9 




>07 


36.036 -r 34 ■ 

i 


LJ 






.LJ 


Is/ 


Nunfcer of Students Form A 

Form B 










KR20 Reliability 


.11 


.0 7 

*3. 






Mean Reading Score 


2o<0 


SLD.D 






Correlation: Scale and Reading 
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(C2) Mental Arithmetic 
(Student page is shown on the facing- page.) 



Srtph of CI us Hi«ns 




Frequency Distribution 



Score 


% of students 


O 
1 


CSrV 


Mw-CSrtf 




* 6 


o£ot 




2-4 
5-7 


16 11 
46 5i 


32.27 


B 

'1 


If * 
lHo| 


10 05- 
* 06 02 



Comments: 



"JUL? S^«l2 V S5 t 2§5 W3S ab °c Ut - he Same for the multiplication- items of fcorm A 
(mean score of 5.9 versus 5.2) as for the di'vision items of Form B (4.9 versus 4.2) 

-The second last item was evidently too difficult in its present form. Perhaps 
something like "12 x |~j = 25 x 36" would have been better. 
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(C3) Mental Arithmetic, Site B 
Addition 



Test Items 



Percent 
Correct 
C N 



Bi serial 
C N 



ERIC 



501 + 501 + 501 + 501 



+ 125 = 250 



9,001 + 



= 9,100 



125 + 125 ♦ 225 4- 225 = 



4,999 + 



= 10,000 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



A22 



(,1 



SO 



IpO 



57 



«3 



3o 



63 



.of 



3/ 



11 



St 



1* 



. 6/ 



6/ 



S3 



.31 1 



3H 
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(C3) Mental Arithmetic - Addition 
(Student page is shown, on the facing page.) 



Frequency Distribution 




Score 


% of students 




csrtp 




O 


03 


08 


i 


10 


n 




47 


* GO 


4* 




10 


5 


20 


10 



Comments: 
See page A29. 
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(C4) Mental Arithmetic, Site B 



Subtraction 
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ERIC 



Test Items 


Percent 
Correct 
C N 


Bi serial g 
C N 






T 


i 

l 






* 






459 - 


- 359 = 


\ 




9/ 














1 
l 

i 










7,001 - 


■ 6,999 - 


L 










• vs> 


5 


; 1,000 - 5 = 






Of 3 




.47 


•5/ 


i 




- 

\ 














TOO 


- 401 = 










. 6>6 


i 

) 


• 












( 






— 250 = 


150 


vy 


.?/ 




i 


































Number of Students 














KR20 Reliability 














Mean Reading Score 














Correlation: Scale and Reading 

1 A. 
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(C4) Mental Arithmetic -Subtraction 
(Student page is shown on the .facing page. } 

Graph of ClUf 




Comments: 
See page A29. 



Frequency Distribution 
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(C5) Mental Arithmetic, Site B 
Multiplication 



Test Items 



7 x 30 = 



3 * 125 = 



x'3C 'as 900 



7 x 



280 



x 250 = 500 



12 x 500 ~, 



30 x 20 x 5 = 



11 x 273 = 3,003 



22 x 273 s= 



x 585 S 0 



(8 x 29) ♦ (2 x 29) = 



Number of Students . 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



Percent 
Correct 
C N 
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SO 
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Biserial 
C N 
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0>Z 
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4u 



A26 



(C5) Mental Arithmetic - Multiplication 
(Student page is shown pn Jthe facing page.) 

firtph of CI «s Metns 




S,1te 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


6 


6.1 


4.9 





Frequency Distribution 



Score 


% of students 


0 
1 






03 


04- 


2-5" 
6-* 


38 
38 


it 


(O 
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63 


I) 



Comments: 



See page A29. 
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(C6) Mental Arithmetic, Site B 
Division 



Test Items 



210 Divided by 3 = 
500 Divided by 2 = 
700 Divided by 10 = 



800 Divided by 



= 200 



360 Divided by 90 = 



1,200 Divided by 



= 4 



Divided by 3 = 30 



3,600 Divided by 15 

3,615 Divided by 15 

1,200 Divided by 30 

1,200 Divided by 15 



= 240 



= 40 



524 Divided by 524 « 



498 Divided by 



- 498 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



a A 28 
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Correct 
C • N 
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74> 



. 7V 
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(C6) Mental Arithmetic - Division 



(Student page is shown on the facing page.) 



6r»ph of CI us He wis 




Site 


Adjusted Means 


p- value 


CSMP 


Non-CSW\ 


B 


5.4 


3.7 


.01 



Frequency Distribution 
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% of students 
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10 


oo 


ox 




1* 
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Comments : 



-On C5 and C6 combined, there were 11 items administered at Site B which were also 
given at the other two sites. The mean scores for this common set of items were as 

TO I I OWS 





CSMP 


Non-CSMP 


Site 


A 


7.4 


6.8 


Site 


B 


5.3 


3.8 


Site 


C 


3.7 


3.8 



These mean scores were consistent with the ability levels in the sites; the only 
inconsistency in the data is the low score in Site C of students who had the very 
superficial CSMP exposure (which exposure was evidently not sufficient to produce 
improvement in mental arithmetic). 

f 
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E: Estimation Category 

Two kinds of estimation scales were used. In Site C, there were four 
scales, on each of which students were to indicate, by marking an V, which 
of several intervals contained the answer to computation problems; short time 
limits were imposed. These scales were essentially revisions of items of pre- 4 
viously used scales. In Site B, there were four scales, on each of which students 
were to select the most reasonable of three wrong answers to give computation 
problems. These scales were repetitions from'tfie fifth grade study in 1980 
(where their use was not particularly successful.) 



El - Estimating Intervals, Addition page A32\ 

E2 - Estimating Intervals, Subtraction A34 \ 

PA . . , ) Site C 

E3 - Estimating Intervals, Multiplication A36 / 

E4 - Estimating Intervals, Division A38/ 

E6 - Most Reasonable Answer, Addition .A46\ 

E7 - Most Reasonable Answer, Subtraction A42 \ 

E8 - Most Reasonable Answer, Multiplication .A44 / Slt6 8 

E9 - Most Reasonable Answer, Division. ......... .A46 / 



A3! 



> 



(El) Estimating Intervals, Site C 
Addition 



Test Items 



Percent 
Correct 
C N 



Bi serial 
C N 



0 10 SO 100 500 1000 

((fther Sterns used this format) 

2S7 ♦ 2f4 

5t * 49 

19 ♦ 19 ♦ 19 

»i ♦ M-j ♦ 9* 

50.9 ♦ 49,9 

1.5 ♦ 1.5 ♦ 1.5 ♦ 1.5 



7? 
71 

7/ 

33 
37 

0? 



V/ 



53 
37 



.07 
.02 



Number of Students 
KR20 Reliability 
Mean Reading Score - 
Correlation: Scale and Reading 
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.&7 


/&■/ 





(El) Estimating Intervals - Addition 
(Student page is shown on the facing page.) 



Frequency Distribution 



Score 


% of students"" 
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0 
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oZ 






Zl 
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6raph of Class Maans 






1 


2 


3 


4 


All 


CSMP 










-77 


Hon-CSMP 








J.* 




t-Sttt. 

1 




of 7 ./ 


A3 


| 


/J 



Site 


Adjusted Hems 


p- value 


CSMP 


Non-CSMP 


C 


4.2 


4.0 





Comments : 

-The bi serials and KR20 Reliability were low, especially for the "CSMP" group, 
perhaps because of guessing (and it should be noted that rather brief time limits 
were adhered to on all scales to prevent exact calculations). 

-The fraction and decimal items were more difficult than the whole number Items. 

-Roughly the same percent of students chose the next best "good" answer as chose 
the correct answer; and for the last three or four subtraction, multiplication 
and division items an equal number of students did not answer. 
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(E2) Estimating Intervals, Site^C 
Subtraction 



Test Items 


Percent 
Correct 
C N 


Bi serial 
C • N 


W5 - 855 0 


• * 

10 ^ 50 100 500 1000 

(Other items used this format) 








./3 




751 - 245 


Va 






• 30 




105 - 8 


*ft 




• V9 


. /to 




900-401 




35" 


. so 






«i .'50* 


OS 


/3 




.<io 




* «t - **- 


5"/ 


<J / 


.J/ 


. 3(p 




100 - 50.5 


<"7 






• a* 




20.005 - 10.1 


0/ 








V 

* 

0 


• 

* 










Number of Students 




/*/ 








KR20 Reliability 




,3V 








Mean Reading Score 
Correlation: 4 Scale and Reading 




/£./ 


/$:./ 
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(E2) -Estimating Intervals - Subtraction 
(Student page is shown on the facing page.) 



Graph of Class Mtanj 




Frequency Distribution 



Score 


% of students 
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07 
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5S 


,32. 
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Means by Ability Level 



4 





1 


z 


3 


4 


An 


CSMP 










3.1* 


Non-CSH> 










A*/ 


t-St»t.\ 




.do 






.9 



Comments: 



•The percent correct was much lower for the. fraction and decimal items, especially 
those like 60 1/4 - 50 1/2 where the difference was a little less than 10 (see 
also the last two items). 



-The KR20 Reliability was again very low.- 
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(E3) Estimating Intervals, Site C 
Multiplication 



Test I.tems 


Percent 
Correct 
C N 


B1 serial 
C N 


f 

2 x 19 

k 

) 


w iu yj IW $00 1000 

X Other items used this format) 






» ~ T 


. 79 


• 


1 40 X 10 




«y 








11 x 50 






. 3^ 


. 3 S 




4 x 29 




3a 


, 39 






J x 199 


/*' 






•/7 




«^x 401 


3o 




. 3J 






4,9 x 9.9 








• <y 




125 x 0.5 


09 


ov 


• 




\ 

-> 


• 

1 

- 










Number of Students 


f 


/a 








KR20 Reliability 






trv 

• 






Mean Reading Score 
Correlation: Scale and Reading 
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(E3) Estimating Intervals - Multiplication 
(Student page is shown on the facing page.) 



Frequency Distribution 



[Store 


% of students 
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Gnph of Class Mtans 




Comments: 
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2 


3 


4 


All 


cs*> 








1./ 




Non-CSMP 








/ 




t-sut. 






•* 


.3 





Site 


Adjusted Heans 


p- value 


CSW> 


Non-CSMP 


C 


2.5 


2.2 . 


.20 



-This scale is also characterized by low biserials and poorer responses to the fraction 
and decimal items. 
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(E4) Estimating Intervals, Site C 
Division 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 



190 4- 10 



0 1 10 50 100 

(Other items used this format) 

301 r $o 
300 *4 
101 + 9 



9.5*0.5 
100 * 10.5 



33 

'7 

32 

3Y 

/5~ 
37 

3 7 
06 



36 

£>:f 
33 

/3 

/9 
0? 



.<// 

.Wo 
. 30 

• i 



.7? 

. 

.*7 

.7/ 
. 70 



■Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



9 

ERIC 



A38 



f/7 
tS'J 



-.03 



5, 



(E4) Estimating Intervals - Division 
(Student page is shown on the facing page.) 

Graph of Class Hetns 

IT* Trrrni 




Frequency Distribution 



Score 


% of students 


0 
1 






I* 


5Z 
II 


2-3 
4-4 


32 
U 


IS 
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,8 
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00 


oo 

01 



*ans by Ability L«vt1 
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/ ? 




/</ 


/J 









Comments 



-There was a generally lower performance on this scale, though the item biserials 
were considerably higher than in the previous scales. 

-Across all four scales (E1-E4), the mean percents correct for whole numbers versus 
fractions and decimals were as follows 









"CSMP" 


No n- CSMP 


Whole Numbers 


(16 


items) 


51 


45 


Fractions and 










Decimals 


(16 


i terns) 


21 


17 



•■«■•*« k^'v^ui.;, v.u,, C v.t iur ird<.uunb ana decimals were even below the quessinq 
level, indicating a real lack of understanding of them. 

-Across all four scales, there was very little relationship between reading ability 
and scores on these estimation scales. Evea at the classroom level the regression 
lines are rather flat. 
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(E6) Closest Wrong Answer, Site B 
Addition 



Test Items 


Percent 
Correct 
C N 


Bi serial ^ 
C N 


£00 


* 47.377 

26.896 ♦ 31,456 • 51,377 
M f 377 

931 


9/ 




./9 


.CO 




«36 ♦ 31 ♦ 26 ♦ 19 ♦ 27 • 1.131 






■ Do 


.5"/ 




1.331 










- 


3.740 

1.022 ♦ 1.713 ♦ 1.991 • 4.740 




(sH 


~. o£ 






1 1 7 in 










' J V 


10,604 

i0.27o ♦ 558 ♦ 4 • ic cni 






• 57 




s 


19.604 












310 

105 ♦ 97 ♦ 106 ♦ 98 ♦ 104 • 410 




70. 


.01 


. II 




510 












15.030 












5.079 ♦ 5.076 ♦ 5.075 » 15.230 






>V 


■ SO 


> 












Number of Students 






¥7 






KR20 Reliability 












Mean Reading Score 


y 


/3,r 


/M 






Correlation: Scale and Reading 
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(E6) Closest Wrong Answer - Addition 
(Student page is shown on the facing page.) 

Graph of Class Means 




Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


B 


4.3 


4.0 





Frequency Distribution 



Score 


% of students' 






Mw-CSMf 
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(E7) Closest Wrong Answer, Site B 
Subtraction 



Test Items 


Percent 
Correct 
C N 


Bi serial 
C N 










4,744 




i 










7,907 


• 2.249 


- 5,644 
7.744 




f l£r 




./& 


• 


* 


78,412 


- 5,879 


7.250 
23.650 
72.550 

940 


77 




'7 / 




• 
• 




10,153 


- 719 - 


9.340 
10.04O 

332 


73 


57 




• o 


• 




1.213 - 


888 - 


642 
1.322 

9.780 


03 






. so 


• 




101, 787 


* 1.989 


19.780 


SO 


57 


'lb 


•37 










99.780 
1.162 






m 




• 




3,105 - 


1.986 - 


2.162 
2.862 


So 


37 




.3? 


# 


Number of Students 
KR20 Reliability 








3o 








• 


Mean Reading Score 






* 




If. to 








Correlation: Scale and Reading 
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(E7) Closest Wrong Answer - Subtraction 
(Student page is shown on the facing page-) 



# Frequency Distribution 



Score 


% of students 




CSM 




0 


OO 


02 


I 


03 


\6 




HI 


58 


5 


V 


l«f 




n 


• 10 
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(E8) Closest Wrong Answer, Site B 
Mul ti plication 



Test Items 


Percent 
Correct 
C N 


B1 serial 
C N 






980 












9 


x 1,120 • 1,980 
10,080 

257 x 






■99 


.(pO 


- 


21 


x 123 • 2,557 
25,557 


73 




.7b 






8 


1,000,100 • 
x 123*456 • 10,000,100 
100.000,100 




33 


.39 






15 


3.173 

x *,111 • 3U73 
31,173 




V7 




.OS 




52 


1.483 

x 99* • 5,183 
9,883 


S7 




• 70 


si 




11 


1,900 

x 989 • 10,900 
19,900 






. & 


■ 39 


Number of Students 






3b 


p 






KR20 Reliability 








J* 7 






Mean Reading Score 














Correlation: Scale and Reading - 






1? 
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(E8) Closest Wrong Answer - Multiplication 
(Student page is shown on the facing page.) 



Frequency Distribution 



Score 


% of students 
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(E9) Closest Wrong Answer, Site B 
Division 



Test Items 


Percent 
Correct 
C N 


B1 serial 
C N ' 




* 


3 










• 


1,513 -r 498 

/ 


X 
300 




3Q 


• U>o 






181,832 4 9 s 


2,000 
20,000 


si 




•SO 


5"/ 
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980 -f 11 • 


15 
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.14. 


. 3o 






100 












3, Ml 7 (9 • 


s 

50 
500 
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• Ja 


• 


13,980 -r l.*02 


10 
50 


V7 








• 




100 














10 












2,082 -f 39 ■ 


SO 
100 








•3/ 


















» 












Number of Students 






3a 








KR2Q Reliability 














Mean Reading Score 




i 










Correlation: Scale and Reading 
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(E9) Closest, Wrong Answer - Division 
(Student page is shown on the facing page.) 



Frequency Distribution* 



Score 


% of students 
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Graph of Class Means 




l! II ['lllliiflKlii 



Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


B 


2.7 
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L: Logic Category 

\> 

This is a new category, intended generally to assess students'* ability 
to do logical thinking. L3, L6 and L8 are rather classic types of scales. 
L2 and L4 were thought to be similar to, though in a different context from, 
some of the string picture' games. 

L2 - Candy Boxes . . ., p age A50\ 

L3 - Order Relations. A52 \ All Sites 

L4 - Identification A54 / 

L6 - Implications " A56 - Sites B and C 

L8 - Some/None/All A58\ 

L9 - Venn Diagram, 2-String <A60 N Site A 

L10 - Venn Diagram, 3-String. ■. . . A62' 

The version of L4 administered at Site A had an additional 4-item problem 
so that scale scores from that site are not compatible with scores from the 
other site. 



A49 b' , 



(L2) Candy Boxes, Sites A, B and C * 



Test Items 



Percent 
Correct 
C N 



Ei serial 
C N 



'I. 



II. 



III. 



Then Jane spends exactly 9t. Which box did Jane buy? 



Then Carol spends exactly 15e. Which box d<d Csrnl t«y? 



Which box did Helen buy? 



Which box did Andy choose? 



Which box did Bill choose? 



Which boxes could he have chosen? 

(Data for students who answered onl 
1, 2. 3. 6. 9) — 



(Oat* for percent students who answered 
only- 2, 3, 6. 9) 



CSMP 
Non-CSMP 



Site A Site B Site C 



S3 

57 
79 



37 



3J, 
>1 



3i3 
OA 



1 5* 
1 3 



nn 

Zl 
vie 

so 

So 



• a 

• 7 7 

•77 
•6-f 



17 
lie 

jo 



so 



.35" 
• </3 



^7 
.1*? 

.n 

■ Si 
.50 



00 



0? 

10 

AO 



'If 

.15 
• V/ 

• Si 

a 7 



/ 



Number of Students 



1 1M 



\U>1 
'51 



KR20 Reliability 



Mean Reading Score 



.5% 



\toO 
■ loO 



Correlation: Scale and Reading 
"3~ 



2.0.0 
j.o-0 



35- 



/3.9 



,.2.3 
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(L2) Candy Boxes 



Thest «rt th« 
boitf «f c«ndy: 



" *"N [j*j~N hum J u m. I 



Th.,. .r, 3>, t < rU: %rU> M(n> ^ 

»rt tilt fteti: 

Etch Jlrl clw,« t box ind bvyl tvtry «ndy In th, box. 

I»ch gtr^ehoot** « <lff.r«nt box th.n th* otter jtr1». 

%rt» cteo> M th* « box. Jh. awld fptn4 H or it „. )|t)0 ; u<( „ d M on- 

Thtu «r» th* taut: 



c^ooits * dlfftront box than 1111 

«o mtttr tow «ny cwd1« *n In «i 9 f P 

T*€* Jmo sponds oxityy f*. * 1ch tex M ^ ^yl 
^Thon.Urol spends 15i . ^ tox d1(J ^ buy? 

*>1ch box dH Htlm buy? 

J. Th1f tin Vim Art muty, mny bom. 

Id Is chooiinf « box. 
Ho etooscs i box wd loots 1ns1dt. 
It ho wort than 1 cwdy and ho hts to spond.twctly 
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.Adjusted Means - 
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Non-CSK? 
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Frequency Distribution 
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Auns by Ability laveT 
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Non-CSMP 
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Site C 
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t-St»t.' 
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Comments : 



-The three problems were intended to be of gradually increasing difficulty. -The 
high percents correct for the three items of the first problem -indicate that the 
students understood the directions and were able' to do a fairly easy problem 

.Hdwever, on the second problem «•% of the students combined more than one box, 
indicating $ misunderstanding of the task. 

-few^student?, got the .last item "correct", i.e., gave all the possible answers, 
instead students gave 1, 2, 3, or more answers. - *r- 



(L3) Order Relations, Sites A, B and C 



Test Items 



Sites 
and* C 



John 1s tiller thin 8111. 8111 1s taller thin Tocf. 
too Is tallest? John 81 1 1 Toa Can't Tell 



"Dave 1$ shorter than J1«. J1b 1s shorter than Andy. 

too js tallest? Pave Jig Andy Can't ttll 



Paul 1s taller "than John. John 1s shorter than Bob. 
.too 1s tallest? Ftul tob uU 



Ann 1$ taller than 8arb and Carol. 
Carol 1$ shorter than 8arb and 01ent. 
too, 1$ Ulltst? Ann laro Carol 
too 1$ shortest ? Arm Bart Carol 



01 ant 
01ane 



Can't tell 
Can't tell 



The banker 1s one of these *en: S«1th, Jones, Brown, William, Gates 
The banker 1s the tallest and fattest ean. 
Sertth 1s taller than Jones, but shorter than 8ro*n. 
Irown 1s fatter than William, but thinner than Selth. J 
too 1s jftt banJter? SeHth Jones trvmn ' W111le*s Sates Caj{4*W 



There Ve 5 children: If 11, Karl a, Tony, Helen and Abby. 

fill 1s taller than Maria but not as tall as Tony. 

He ten and Maria are taller than Abby. 

Helen 1s taller than Maria but not as tall as 8111. 



I 



too 1s tallest? 
too 1s shortest? 



1111 



Maria 



1111 ' Maria 



fcplen ' Abby 
Helen , • Abby 



Tony 
fTony 



Can't tell 
Can't ttll 



Ellen 1s not taller then Linda. 

Uttda 1s shorter than Kare^ 

i i 1 



Who 1s shortest? 



Linda 



Ellen 



Kantn 



Can't tall 



CSMP 

Non-CSMP 



Site A 



Site B 



Site C 



Percent 
Correct 

C , N 



(07 



6? 



1* 



47 



St 



15* 



n 

no 

so 



S/ 



JO 



90 



3/ 



2.0 



Bi serial 
C N 



. a i 



'/J 



at 



•si 



92 



of 

•el 
■So 

-. 07 



.03 



•s>* 
..a? 

.V7' 

.oS" 



.31 



•Number' of Students 
KR20 Rel,*abil/ 



7SL 

*2/ 



l.bl 
'47 



•57 
.4)3 



.39 
./9 



■ 33 

.3$ 



Mean fa^dinc^ Score 
Correlation: Scale and ReacRnc 



20.0 
20 6 



13. 9 



/6. / 

IS- 1 



* ' i 
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A52 



(L3) Order Relations 

(Student page is shown on the facing page.) 

Srapti of CI us Metns 




Site B 



Freq uen cyrDi s t r 1 b ut 1 on 
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Nuns by Ability l»vt1 
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Comments: 



-Items like the ones in L3 are commonly used as a measure of verbal reasoning. 
The first item is as straight forward as can be imagined; yet a third of the students 
at Site B, and half at Site C missed the item; 
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^-lliJL. Identifkati on^ 



Sites A, B and C 



Test Itews 



Percent 
Correct 
C N 



Site A 



81 serial 
C N 



Site B 



Percent 
Correct 
C N 



B1 serial 
C N 



Percent 
Correct 
C N 



Sit* C 



81 serial 

C r N 



I. 



What 'league does each boy play in? Bill 
/ Tom 

Ed 

Pete 



How manj leagues 



4S * 3 

Or -><> 



7/ Jo 



5b 5".? 



38 33 



•56 -3? 



• 66 -70 



II 



Which league does each boy play In? A 

3 
C 
0 
E 
F 



ST 



55" 



*+7 *»f 



-II <U 

«=»} «ni 



Then »rt 4 girls: 
There ire 4 d»ys: 

0 

Thtrt *rt 4 sport 5: 
These »re the ficts: 

in. 



n v? 

37 3/ 
33 37 



.7? .7J 

."SO .«rg 
• ST 

.^7 -?3 
?5" ,76 



•5"7 <W 



i/3 4b 

35- 3/ 
*9 «?s- 



Ann Bonny Carl a tori* 
Monday Tuesday Wednesday Thursday 
Bicycling Mming Volleybill Horseback Riding 
Eicn girl takes one lesson 4 neck In her sport 
Each girl pUyj » different sport. 
Bonny takes lessons onHTuesday end doesn't take spinning 
Ann'tekes volleybell end doesn't tike lessons on Monday. 
Ooris takes lessons on Wednesday tnd doesn't take bicycling or swtoing 



Data Not Available 



Form B, page 2, Site A of?y 
Where does each traveler. go? 

.IV. 



3V 3 3 



•14 4v 
31 H 
4*7 ti" 



•f <i H I 
SI *3 



./7 .y<? 



-7a TO 
.-73 17 

■21x 



Number. of Students 
•KR20 Reliability 
Mean Reading Score 
Correlation: Scale arid Reading 



'Iff? 

.a 



(p4 27 
n '83 



.50 



/07 

go 



/3"7 



.39 
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I. 



II. 



IV. 



(L4) Identification 



n*st trt tht 4 boys: 
T*tst art tht 4 lttguts: 
Thtst trt th« ftcti: 



1111 



Tom 



Nti 



I 



ERIC 



Cach boy pUys in t difftrtnt lttgut. 
•111 flays indoors. 
T « dotsn't pity hockty. 
Cd doesn't pity outdoors tnd fit doesn't pity f0 cctr. 



ion 



*«t lttgut dot s tacit boy pTtylnl (Clrclt'your anvtrs) 

^ 



Thtrt art 3 sports: soccer, hoctty and basketball. 
*or tech sport thtn trt * Itaguts: in Indoor lttgue end. en outdoor Itagut, 
Mow «tny lttguts tn there? _ 

^ ir * f *"«- boys trt called A, |, C , tnd so on. 

Ctch boy plays on t different leegue. 
A tnd C pity btskttbtll. 
I and 0 don't pity soccer. 
A» l» *hd Z pity indoors. 

»i1cft leegue dots ttch boy pity In? 



Score 


X of students 




csnp 


N.^srtP 


n 6 C 


A 6 C 


0 


03 o? |$ 


6t 03 05 


1 


05 c* 
27 51 X 


oS 67 
35 52 Ct 


&-IZ 
i>-i5 


f 7 27 27 

1*1 04 OS 


37 30 25" 
'7 o« oi 



Tfctr* trt 4 trtvtltrs: A, I, C tnd 0 
Etch trtvtltr gots to t different dty. 

tech trtvtltr usts t difftrtnt kind of trensporte 

Tht st trt tht ftcts : 

^ Thtrt trt no trains through Southto*n. 

I tlwtyt f)1tS. 

Tht only wty to gtt tp Eastburg 1s by ctr. 

C travels by bus tnd doesn't go to UtsthUl. 

A doesn't trtvtl to Etstburg. 

toly trtlns go to Horthvlllt. 

Plentt don't Und tt Southtown. 
* 

W*rt dots etch trtvtltr go? 



fctn* by Ability Uvtl 



Sit^fe 
csw 

trtln and pltnt. 

VSUt. 

* 

Site C 

CSUP 
Non-CSH 5 




z 


T 

3 


4 ah 








3.9 








tr./ 


to 


tr.7 


1 




/ 3 


-.o 


O.u • 


Ml 


«ns by Ability level 




1 


I 


3 


4 ' 


An 






Ce. O 




&./ 








'3,0, 


s~- 


t-sut. 


V.3. 


0. 2 


/•3 ! 


/. / 





m * 1 — 


■ — , 






Adjusted Means 






Site 


CS*> 


Non-CS>f> 


p-value 




OA 


8.3 


.8.3 




<• * 


OB 


6.1 


~5.6 




• 


AC 


5.7 


5.5 





Comments: 



"Sf * S 5» d ^ t: » ' te$ t ^lets 'showed the Infonnatlon about each*p1 a yer In sucb a way 
:e h l S a t n^n t 5 0 o?;: u t^^. USed ^ * P keep1 " 9 ^n^ts Jo' "* 

-Typical errors were the violation of one or more rules. » 

-The scale, although similar to the String Game, elicited no transfer. 

-The performance at all three sites Is comparable In spite of ability differences. 

A55 



73 



(L6) Implication, Sites B and C 



Test Items 


Percent 
Correct 
C N 


Bi serial 
C N 


Thrtt fHtnds 90 shopping: 1111, ltn tnd Allct 
Thtn ar* two boxts: Hut tnd (mo 












If B111 buys 1 blot box, ht alio buys • gr*tn box. 
Ht dots not buy 1 grttn box. . 
Dots ht buy • blut box? Yts No 
(Clrclt your tnswtr) 

\ Ltn buys • blut box or 4 grttn box. 
Ht dots not buy 1 blut box. 
Dots ht buy 1 grttn box? Yts No 
(Clrclt your answtr) 


Ctn't ttll 

Ctn't ttll 
♦ 


fS 
// 

(pO 


1(1 V. 


.0$ 


.01 

•'35* 
•33 


Allot doesn't buy both 1 blut box tnd 1 grttn box. 
Sht buys 1 bibt box. 

Dots sht buy /grttn box? Yts No 
(Clrclt your answtr) 


Ctn't ttll 


/a 




-Jo 


-of 


m 

% 

? 












J 

t 


\ 










— *v 

Number of Students 
KR20 Reliability 
Mean Reading Score 




a? 
is. 9 


'S.O 

ir.j 


i 




Correlation: Scale and Reading" 




• >? 


f 





i 

(16) Implication 

(Student page is showri on the facing page.) 



Frequency Distribution 



Score 


X of students 




CSrtP 




Sfte: 


B C 


B C 








1 






Z 




Sd is 


3 


Ob Of 


/b u 

* 



6wph of CUn Hmas . Site B Nuns by Ability L«vtl 




(L8) Some/All /None 



Test Items 



Percent 
r Correct 
C N 



Biserial 
C N 



Form A 



If Matt Uves 1n Texts, fien Mat: travels by horse. 
Matt travels by horse. Ooes Matt live 1n Texas? 

If Ellen wen*, shopping^here, then Ellen bought shoes. 
Ellen went shopping here. Old Ellen buy shoes? 

If fish are pink, then turtles are yellow. 
Fish are not pink. Are turtles yellow? 



JJ2 

63 



4. If 1t 1s raining, then the field 1s purple. 
The field is not purple. j s 1t raining? 



5. If the sun 1s shining and 1t 1s Sundav. *h*n we wi 1 1 go on a picnic. 
It is not Sunday, will wt go on a picnic? 

6. All mallards are ducks 

Some (tucks are opera singers. Is there a nallard that is an opera singer? 



*7r 



cry 



/y 
?/ 

Ob 



7. If the spider Is crawling or If the snake Is moving, then I will scream, 
t will not scream. Is the spider crawling? 

8. If all the houses are green, then we are on Main Street 
This house 1s not green. Are w« on Main Street? 

9. Snakes don't ambulate. 

Some of my pets are snakes. Oo any of my pets amoulate?* 



2/ 



2-C 



V/ 



5~S- 



6>V 

re? 



•3</ 



Form B 



1. If Matt lives 1n Texas, then'Matt travels by horse. 
Matt doesn't live 1n Texas. Ooes Matt travel by horse. 

2. jf Elle' weit shopping here, then Ellen bought shoes. 
Ellen didn't Buy shoes. Old Ellen go shopping here? 

3. If fish are pink, then turtles are yellow. 
Turtles are yellow. ^ f1sh p1nk , • 

*■ If 1t 1s raining, then the field Is purple. 



/3 



a 3 



It 1s raining. j s ^ f1eld p^p^? 



r 



5. If 1t 1s Sunday and the sun shines, then we will go**on a ptcnlc. 
It 1s Sunday. we go on a picnic? 

r • 

6. If the spide: 1s crawling or 1f the snake 1* moving, then I will scream. 
The snake moves. W11l j screim? 



2 



*7f 
-8o 



7. If all the houses are green, th*n we are on Main Street. 
This house 1s green. Art we on Main Street? 



8. All ducks are opera singers. 

All mallards are ducks. \ s there a mallard that is 



not_ an opera siftger? 



r^cer? 



9. Snakes don't ambulate. 

ft 1 qf ^ t5 *re -snakes, or. ;ny of ^ pets, ambulate? 



5Z, 



*7 



Number of Students 
KR20 Reliability * 
Mean Reading Score 
Correlation: Scale and. Reading 



Fonff A 
Form 



02 



(*(, 



31 



.o 3 



iCe T 



2/ 



9 

ERIC 



(L8) Some/All /None 



If Matt lives In Texas, then Matt travels by horse. 
Matt travels by horse. 



Does Matt live In Texas? 



Yes 



No 



Can't fell 



firjph of Class Mains 




Frequency Distribution 



Score 


% of students 


0 


CSttP 






ft 6 


k oz oa 


05 OS 

05 off 


2-4 
5-4 
1 


ZH- 25 
7o <H 
oo 2( 


»H 20 
oo ZO 


d 
1 


OO 15 
OO 00 


oo o5 
oo oZ 



Site 


Adjusted Means 


p-vilue 


CSKP 


Non-CSHP 


A 


4.9 


4.8 





Comments: 



-Items of the type If A, then B. when A is not known, are not "natural" 
examples of reasoning, and both CSMP and Non-CSMP students' scores on these 
items reflect that. * * 
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i 



(L9) Venn Diagrams - 2 String, Site A 



Test Items 



Percent 
Correct 
C N 



Bi serial 
C N 



In Mrs. Jones 1 cUis: 

11 student*' wear tennis shoes. ^ 

\f students wear glasses* 

8 students weir tennis shoes end glasses. 

2 students don't wear tennis shoes or glasses. 

Writt your tnsxersjn the blanks. 

How aeny students are there In Mr*. Jones 1 class? 



How ttny students wear tUhtr tennis shoes or glasses but not both? 
How miny students wear glasses but not tennis shoes? 



or 

/3 



Number of Students ' 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reac 



*W* 

/o 



• CI 

.77 



^7 
Oo-O 



0> 3 



./8 
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(L9) Venn Diagrams 

(Student page is shown on. the facing page.) 



6nph of CI us H»«it 




Frequency Distribution 



Score 


% of students 






Mw-CSrtf 


O 






I 


OS 


o(o 


1 




05 


3 


o3 


00 



Site 


Adjusted Means 


p-v»lue 


CSMP 


Non-CSMP 


A 


0.2 


0.2 





Comments : 



-Not enough time available to complete the scale may have been a factor in the 

■+Jlt e cl success with this scale - Nevertheless, it is ^uprising that practice 
with the String Game did not translate into higher scores for CSMP students 



' J 
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(L10) Venn Diagrams - 3 String, Site A 



Test Items 


Percent 
Correct 
C N 


Bi serial 

C . -N 


< 


In Mr. Smith's class: 

18 students play baseball. 

13 students play basketball. 

21 students play football. 

No students play all three sports. 

Ho students play both baseball and basketball. 

7 students play both football and baseball. 

17 students play football- 'but not btsketball. 












How many students play baseball only? * 


/? 




'Of 


4*1 








\J Or 


• f 7 






How many students play basketball only? 

t 




03 


. oO 


143 


♦ * : 

4 « 

* 

1 

f 


> 


• 


- 

1 


- 




Number of Students 












KR20 Reliability 












Mean Readiag Score 




;*>./ 


do, a. 






Correlation: Scale and Reading 
9 1 










. it 
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(L10) Venn Diagrams 

(Student page is shown on the facing page.) 

Grtph of Clus feans 




Frequency Distribution 



[Score 


% of students 




CSf\(> 




0 




** 


I 


« 


a 


X 


00 


01 


3 


00 


01 



Site 


Adjusted Means 


p-value 


CSKP 


Non-CSMP 


A 


0.3 


0.3 





Comments : 
See page, 61 . 
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N: Other Number Systems Category 
(Fractions and Decimals) 



9 



ERIC 



This is the most complicated category to report. The scales will be ordered 
so that similar kinds of scales are together, rather than by the numerical 
designation. 

Representations 

N3 - Measuring Fractional Inches pag e A 66 Site B-Repetition from 

5th grade. 

Ml 5 - Fractions and Decimals on the Number Line . . . A68 Site C-Extension of N3. 

. N5 - Fractional Areas , A70 site B -Repeti t/ ion from 

5th grade. 

N10 - Other Representations of Fractions A72 

Computing Exact or Approximate Answers 

N6 - Equivalent Fractions , . . . A74 Site B-Rep4tition 

1 ' ' 
N6 - Equivalent Fractions and Decimals A76 Site A-Extension N6 

HI -^Fractional Open Sentences A7a Site B-zfiepetitior 

Site A/Extension of Site B. 

N16 -'Fractional Open Sentences A80 Site/C-Simi lar to N7 

^12 - Decimal Open Sentences A82 Site A-New. 

N14 - Fraction and Decimal Computation A84 Syte A-New. 

N13 - Approximations with Fraction A86 Sites A, C-New. 

Relative Size % / 

N4 - Decimal Magnitudes .■ . . . ^ A8^ Site B-Repetition 

^ Site A-Extension of Site B. 

N8 -'Which Fraction is Larger A90 " Site B-Repetition 

Site A-Extension of Site B. 
Nil - Ordering Fractions and Decimals .A92 Site A-New. 

N17- Fractional and Decimal Order ; . . A 94 Site C-Revisfon of 

above scales. * 

Word Problems 

Nl - Decimal Gas , / A 96 Site B-Repetition 

N9 - Fractional Word Problems. . . - A98 S i te B-Repetition 

«•* 

A65 , , 



kJ 



* (H3) • Measuring Factional Inches, Site B 



Test Items: 



percent 
'Correct 
C . N 



|iseria1 
C. N 



« ■ 



Tht arrow It pointing at 

\ 



hit an arrow at 4^ 1n. 



^ hit an arrow at 3j In. 



4 

f| M'j'i'iTi/rjTj'ra 

{ J In. 4 fn. S In. 1 

n • , . 1 1 j i j • , , | • , , j i , • | rj i j v 
{ " $ In. 4 In. I to. ) 

: n • i • | • i • | « i; j ; i • |-t i : « | • i y 

{ 3 Jn. ' 4 tn. I 1n. J 



09 



9> 




<T3 



/3 



Number of Students 
KR20 Reliability 1 
Mean Reading Score- 



32 



Correlation: Scale and Reading 



a? 



.5-5" 



S"5" 



S8 



*7 



?7 



3*, 



A66 



ERLC 



.53 



3$> 



(N3) MeasurJ^ Fractional Inches' • 
(Student page is shown on the facing page.) 

Snph of CI us fetns 




Site 


Adjusted Heans 


p- value 


CSMP 


N on -CSMP 


B 


0,5 


1.0 


.20 



Comments; 



Frequency Distribution 



Scone 


% of students 






Mw-CSMf 


0 




3$ 


1 


3* , 




1 


U 




3 


63 





-This-*cale was repeated from fifth grade, with virtually jio improvement from one 
year 'to the next, except for one high storing class.' Students especially had 
trouble with quarters of art inch on a rulec marked with eighths of an inch. 



V 



x 



\ 



ERLC 



A67 



Test Items 



Percent 
Correct 
C N 



Bi serial 
C* N 



• f ; 

CtrcJt tut irro. th.t *»n_ to jj. on Oil nwe.r Ht*jMi<m. 
~* '— « ^ ri X J, J/ 



2\ ' 1 

Clrclt tht trrow that points to J on tht nu**r Hot 



4 



b^Jow. 



Circle irrow tht) polnu to On tht nuttxr lint bolow, 

■ ■ + — * W — Li 



0.8 



1.0 



1.2 



1.4 



1.8 



"i r- 

2.0 2.2 



Clrclt ti* trrow tht't points to 2.3 on tht nurttr lint Mow. 

-r^ * 



* • 



Cirelt tht tnrow that points to 1.25 on tht mj*tr IJn^btW 
, X r± j_J 



4 



Clrclt tht trrpw thtt points to 2.05 on tht nurttfr lint Mom. 



4 



4 ■ 



J £ 



^ 2 



1 




>5t. 



It 



ay 



. of 



/3 



of 



04 



.of 



.3/ 



OS 



. so 



umber of students 

0 Reliability 
Mean Reading Score 
Correlation* Scale and Readihg 





*6 




•3? 







•37 



A68 



Ho 



1 



er|c 



(N15) Fractions & Decimals orTtfie Number Line 
(Student page -is shown on the facing page.) 

Srtph of C1«» Htans 




Site 


Adjusted fean< 


p-vilue 


CSMP I 


Non-CSMP 


. C 


1.6 


1-3 


.16 



Frequency Distribution 



Score 


* of students" 








0 
t 


n 

31 


28 
36 


5" 


52. 
06 


01 


V 


06 j 


00 I 

• 



% *ani by Ability Ltvtl 



CSH> 
Non-CSMP 
t-Stat. 



1 



1 


Z 


i 

3 


4 


All 


AS 


A6> 


/9 


A* 


AO 


Jj 


A 7 


// 


/£> 


A3 




0,5^ 


\27 


0*^ ' 





Comments : 



'This was a new scale intended to assess students understanding of the relationship 
between fractions and decimals. '* r * ' / 

-Gecherally poor' performance; the second and third items show a real lack of understanding. 



8u 



ERIC 



A69 



(N5) Fractional Areas, Site B 



Test Items 



Percent 
^Correct 
C ' N 



Bi serial 
C N 




3 
I 



1 

I 



1 
I 



1 
J 



1 

T 



l 
7 



2 
J 



i 




1 

T 



3 
I 



Shade j of the figure. 



Shade j of the figure. 
» 

Shade j of the figure. 



none 
of 

these 



none 
of 

these 



none 
of * 
these 



none 
of 

these 



none , 
of 

these 



s/ 



&3 



/o 



SI 
7© 




1 






i 










r 






i 



3o 



43 



6? 



5jT 



7£> 



MX 



2/ 



.^7 



3<3 



£7 



JO 



86? 



5? 



■ u>?> 
-S3 



Number of Students v ' 

^KR20 Reliability . 
Mean Reading- Score b 
Correlation: Scale and Reading 



So 


¥9 






fV.3 

V 




.y? 
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i V; 



(N5) Eractional Areas 

(Student page is shown on the -facing page.) 



Graph of Class Hems 




Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


B 


3,7 


2,4 


.09 



Frequency Distribution 



Score 


% of students 




csrtf 




0 


03 




I 


07 






*3 






f7 




7 


07 


oZ 


8 




oo 



t t t 

Comments : 

-This scale was repeated from fifth grade. 

• ♦ 

-Performance was quite satisfactory when the fractional representation was on parts 
out of n for the fraction m/n but did poorly oiy-tremk where , for example. 2 parts 
out of 6 was for 1/3. . f J . 
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(N10) Other Representations j*f Fractions, Site B 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 



Circle the arrow that points to | on the nutter line. 

f * i i ■ ■ i 



Circle the arrow that points to i*. on the m*ber lint. 



r 9 - c 

Circle the. arrow that points to g on the mrt>er line. 



1 i i 



Circle the arrow' that points to 2^ on the n,u**>er line. 



Each bucket holds 1 gallon. 

Ho* «any gallons are shown? Circle the best answer. 

r 




4 



Ho. etny 9*11onj »rt jho«n? , Circle the best enwer. 



? 1 



-?7 



6>7 



fro 



Vo 



77 



0? 



7/ 



.fr* 



2T7 



37 



72 



i 

33 



73 



4/ 



33 



.S3 



3J 



Numbe*.6f Students 

* * ♦ 

KR20 Reliability 

* 

Mean Reading Score 
Correlation: Scale and Reading 



3o 
#5 



</<? 



,*1 



-A72 



(NIG) Other Representations of Fractions 
^ (Student page is shown on the facing page^)- 



Qr%ph of CI us Ntaiis 





Frequency Distribution 



Score 


X of students 








0 




to 


1 








53 


C3 




10 


oo 


c 


*»3 


^0? 



Comments : 

-This scale was repeated from fifth grade 
-The CSMP advantage was due mainly to one very low scoring Non-CSMP class. 

* 

.-The performance on the first item was surprisingly low. ■ 
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(N6) Equivalent Fractions, Site B 
A 



Test Items (See facing page.) 



Percent 
Correct 
C N 



Biserial 
C- N 



20 items, as shown below. , 
Statistics not available. 




2 
6 



50 
150 



11 




9 

12 



31 
41 



6 

7 




20 
100 



5 

T 



11 

15" 




-25 
4T 



4 



30 
4? 



13 



5 

25- 



3 
7 



4 
12 



400" 



2 

10 



5 

15 



A. 



Number of Students 

KR20 Reliability 

Mean Reading Score 

Correlation: Scale .a^d Reading > 



3* 



47 



^2. 
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(N6) Equivalent Fractions 



Circle all -the fractions that are equal to the "one in the box, 
There are usually more than one. 
The first one is- 'done for you/ 



Samp,! e 




4 
7 




1 

10" 



20 
100 




(N6 1 ) Equivalent Fractions and Decimals, Site A 



Test Items 



Percent 
Correct 
C N 



B1 serial 
C N. 



3/4 



1/5 



0°.6 



4/5 



1/4 



0.75 



.34 

12/36 

.75 



69 
59 

80, 



75/100 

7.5 

4/3 



77 
77 
83 



.50 

20/100 
.02 



64 
74 

69^ 



20/50 

0.5 

4/20 



75 
70 
67 



"0.60 
60/100 
0.060 



70 
66 
77 



12/20 
6/100 
3/5 



30 
58 
38 



0.45 
16/20 

■sSS'/W 

8.0 
5/4 



68 
69 
42 



0.40 

25/100 

0.025 



74 
81 

21. 



81 
74 
73 



10/14 

0.25 

5/20 



81 
74 

■73 



0/750 

75/100 

0.Q75 



56 
82 
73 



15/20 • 
1.3/1.4 
3/4 



37 
84 
71 



63 
57 
57 



.92 
.48 
.94 



67 
73 
75 



.83 
-.80 
1.14 



60 
63 
70 



i90 

:si 

.49 



67 
60 
60* 



.96 
.85 
.58 



65 
40 
71 



.62 
.56 
1.02 



13 
41 
14 



,42 
.81 
.55 



58 
71 
33 



61 
74 
74 



67 
67 
62 



.68 
.47 
.45 
T78~" 

.80 
_£5_ 



.94 
.93 
.69 



75 
57 
71 



.97 
.81 

,65 



54 
66 
56 



.32 
.99 

,88 



32 
67 
53 



"47 
,92 
.79 



Number of Students ' 
VR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 

"eric - ~ ~ 



Form A 
Form B 



64 
62 
.91 
.89 

19.7 



63 

63 
.90 

.91 

20.3 



46 



A76 



(N6 1 ) Equivalent Fractions and Decimals 



Clrtlt «11 tht munbtrs thit «rt tqu«1 to th« on* In V* box. 
T*«rt 1i usually ion ttiu on«. Tht first on* If don«|tor *<*. 



0- © f u (Si® 



Grtph of CI 4$$ Httns 




Frequency Distribution^ 



Score 


% of students 




csnp 




o 
1 


o1 Ot 

00 60 


««f if 

00 06 


7-ft 


03 0? 
22 it 
56 53 


03 00 
Zl 3t 


n 


08 io 


OS" 03 


16 


08 » 


63 u. 



Comments : 



-This scale was a revision of N6, changed so that instead of merely equivalent fractions 
fractions and decimals were mixed together within each item. 

-There was a fairly large difference between four classes scoring around 16 and the 
other eight which scored around 12, the difference appeared not to be related to 
ability level and not strongly related to curriculum. ' * 




(N7) Fractional Open Sentences - Sites, A and B 



Test Items (see facing page.) 



\ 



Percent 
Correct 
C N 



Biserial 
C N 



T 



Site A 



CoapItU tftt wuncii: 



Site B 



□ 



10 



3C* 



12 



T— 1? 



0.5 ♦ 



39 



» ■□- 

»♦-□ 
.-»-□ 



£~7 
S"7. 

37 

9 2 . 

ft* 



7V 



33 



33 



<P3 



>&9 



07 



\ 



-y/ 



C3 



Ce>/ 



33 



o3 



02 



0(k> 



37 



. 5> 
,70 

. ?* 
• 65" 



.37 



3/ 



1 3? 



0/ 

. 77 
.70 



Number of Students 
KR2Cf Ffeli ability 
\Mean Reading Score 
Correlation: Scale and Reading 



Site A 
Site B 



0/ 

30 
•77 



.10 
/9-7 
HO 



9 
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(N7) Fractional^ Open Sentences 
(Student page is shown on the facing page,)* 



firapti of Class Mians 




t S1tc 


Adjusted Means 


p-value " 


CSMP 


Non-CSMP 




2.4 


1.7 


.01 


1 

°B 


2.3 


1.4 


.25 



Frequency Distribution 



Score 


% of students 


SITE: 

0 

t 


csr\p 




A B 

t3 lo 


rt B " 
»i 35\ 


f 


33 3T7- 
25 lo 
2.0 lo 


4 ' 


5 


o* 03 
X 13 


W 00 " 

X oo 



Comments : 



Note: Sites A and B had different sets of items. 



-At Site B, the scale/vta<i a' repeat from fifth grade; at Site A about half these items 
were changed (and made/rtore difficult).. 



-At Site B the -mean peAents were 40% correct for CSMP and 25% for Non-C§WP-. 




(N16) Fractional Open Sentences ,-.,$$te C 



Test Items 



r 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



9 

ERIC 
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X 1 



s 10 



1 

T 



1 - 4 = 



1 
I 



-r 2 = 



3 . 

7 ~ 



1 



1 



Percent 
Correct 
C . N 



04 



3/ 

/ . 

03 



Bi serial 
C N 



! V7 

or 

i 

of 



53 

V7 



3? v ' V7 



a? 



0O 



8V 













/3 



33 



.3/ 



,U7 



.37 



O 



(N16) Fractional Open Sentences, 
(Student page is shown on the facing page.) 

6r*ph of C1*ss feus \ 




Site 


Adjusts ffeahs 




CSMP 1 


Non*CSK> 


p- value 


C 


2.7 


2.8 








t 





CSMP 
Hor-CSH> 

t-SUt. 



Frequency Distribution 



Score 


%.of students 






IMn-CSMf 


6 


it 




I 








' % 








o8 


7 




■oo. 


8 


06 


00 



fc*n$ by Ability Ltvtl 



1 


2 


3 


4 


All 






4*0 




47 


■ 








4-f 






AO 


0-V 


.2 



Comments: 



-The first s.1x items of this scale-were the same as scale N7 at- Site B. The -mean 
percent correct for these six items in Site B was 40 for CSMP versus 24 for Non-CSMP 
while at Site C the perceats were 29 for CSMP versus 21 for Non-CSMP. 
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('N12) Decimal Open Sentences, Site A 



v Test Items ■ . . 

J 


Percent 
Correct 
C N 


Biserial * 
C N 


• 


*, 


* 




— > 










• 




0.5 ♦ 




• 1 

> 


t # w 


/ to 


1*1 

0 








0.8 -r • 




■ 1 




MS" 




>?> ' 




• 


- 0.5 x 




• 10 

1 

\ 






V 




• 




6.5 - 




• 6 




% 




a 




















• 


f 

r 


t> 

i ♦ 




• 0.75 


< 




or 

- 


0 

t 


• 


\ 

*> 














• 

• 


i * 










* * 




• 


• 


Number of Students 
" KR20 Reliability 
Mean Reading Score 






s 


•Ml 


•<>< 

20.3 




/ 


• 


Correlation: Scale and Reading 








•5° 









(N12) Decimal Open Sentences 

" (Student page used the format 
shown on the facing page) 

Graph of CI us Meths 

[RFTTITirTIM 




Frequency Distribution 



Score 


% of 'students 


t 


cs/ap 




o 




15 


I 


10 


08 




2\ 


.23 


3 


•35 






U 


1* 


5 




oC 



Comments : 



-This was a new scale. 
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(-N14) Fraction and Decimal Computation, Site A 


• 






• 


Test Items - 

» * 


♦Percent 
Correct 
C N ■ 


iBi serial ) 
c 'V« 


» 


7 














i ■ ■ F - T " 

V ^ *- 














> 


7*1" 




* 


31 






•03 










• 






I 




1 5 ♦ 7 . 












'33 




\ - * 












' 










' SV 


.srf 








1 




i 


► 


6.5 ♦ n ■ 






(jb 




* « 








i 






i 




2 x 6.5' • 
















- ... • . — 
















'6.5 x 10 • 










» ri 




> 


6-5 -5- 2 • 






\ 

V 


* 


,6V 

to 


i 














< 




| Number of Students 

* ' \i ' V # 
v . KR20 Reliability ^ - * " 


Cet 
,$7 




f 


^ 


i 


Mean Reading Score 














Correlation: Scale and Reading 


k 




t 






ERIC • , - ^ A84 lU,^ 













(N14) Fraction and' Decimal Computation 

• (Student paqe is- shown on the facing page.) 

- Sngh of Q,1tss Mews 

If™ 




Frequency Distribution 



Score 


% of 


students 




CSrtf> 




0 


OB 




1 


II 


12 


2-3 


15 


32 


<W 


M . 




7 




OS 


8 


10 





-This was a new scale. Although straight computation of decimals was being assessed 
in the last N four items, the horizontal . format was used to avoid giving the students 
the decimals "lined-up" and ready for rote operations. 



X 



o 
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(103*) Approximations with^ Fractions , Sites A and C 



, Test Items . - 

* » 


Percent 
Correct 
C N 


Bi serial 
C N 






















CHE CX 'ONE, 














Uss than 1 


Exactly 1 


Wort thin 1 




















c 




t 


• 












«a 




• 


7 y 7 

F * F 




- 




V 






V 


1 T m 


c 






Si 






1 — *_ 

t 


l.i 

ITT 


• 




W a 






•St 










*» 






•S3 


** 

i 6 




« 


* 


*X 






•34 

• .« 




70 - 49^ 

* 






*» 


55 

30 






» 


( 




- 

/ 


27 




.46 

•11 


an 


* * 


. i ' 

4* — 




% 

• 

% 










/Number of Students 






SUe A 
Site C 




"rr 






KR20 Reliability . 
















Mean Reading Score 






-i 










Correlation: Scale and Reading 

— i ■ ■ ■■ - 













9 

ERIC 



A86 



--lu, 



(N13) Approximations with Fractions 
(Student page is shown on the facing page,) 



Graph of Clm'llMns 




Frequency Distribution 



Score 


% of students 




csnp • 






* c 


0 

l 


02 14 


OX 10" 




16 " SI 

3o 13 

- . ^ 


3? 57 
25" ft 


8 

9' 


0$ 06 
OC 06 


05" oo 
o3 06 



Site C *a/is by Ability Lav«1 





1 


2 


.1' 


4 




CWP 


s.b 










*On-CS*> 


3- 3 


•?■/ 




/■3 




t-StK'. 

1 








/•/ 


c2 6 



Comments : 



-This was a new scale. 

-The 'graph of class means reveals a probable floor, effect due to guessing-, which may 
also account for 'the low biserials in Site C. 

-This was one of the few scales at Site C in which the brief exposure to CSMP may 
have caused an improvement on MANS performance. * 
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*(N4) Decimal Magnitude, Sites A and B 












Test Items * 


Percent 
Correct 
C N 


N B1 serial 
C N 




Site A e 












v 1 ' Which if Urser (Clrclt your wswer) 

. \ 

. % 6.1 or 6.01 1 










• 




h 


/•of 






4.999^ or 5.1 

• • 


f 3 








• 


0.9 or 0.111 


?a 


j 




. Sv 


• 


V 

< 


7/ 




, so 


.73 

> 


t 

• 


1.75 or t i 






/ A, 
















• 












,Site B ' 


■< 










UniCn is itrgtrr 












6.1 , or 6.01 v tClrclt ont) 


^? 


S3 ' 

* 


• 




• 


, w % 1>.5 or 0.58 (Clrclt ont) 






.5V 






* • : . * 

4.077 or 4.155 (Clrclt ont) 


(sic 










4.999 or .5.1 (Clrclt ont) 

•» 






-.ov ' 






0.9 or 0.1H (Clrclt one) 

t 


W 




•/? 




• ' 

4 


Number of Students r • 1 4 Site A . 

CUfl D 
■J 1 Lc D 

KR20 Reliability * 


• $, -32 


% 






• 


Mean Reading Score 


rt-7 ■ 
13-5 


it-: 


•v 






Correlation: Scale and Reading 

\ , , 

• 
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(N4 .) Decimal Magnitudes 



( Student page is shown on the 
facing page) 




Graph of CI us Hews 




Note: Sites A and B had different sets of items. V 
Comments: 



.Frequency Distribution 



Score 


% of students 




CSrtf* 




" \ ft 




1 




01 


2 
3 


U 
16 


28 
"f 


% 


IB 
54 


H 
"56 



Site 


Adjusted Means 


p- value 


CSKP 


Non-CSMP 


°A 


4.0 


3.7 




°B 


5.4 4 


3.3 


.01 



\ 



-At Site B, the scale was a repeat from fifth grade; at Site. A, tV/o of the items were 
revised. On the three common items, the mean percents correct at.Site A were 83 for 
CSMP versus 66 for Non-CSMP; at Site B they were 66 for CSMP versus 3-3 for Mon-CSMP. 
Thus, the CSMP students ,at Sit? B performed as well as the Non-CSMF\ students at Site A. 

-At Site B, the graph of class means shows a negative relationship wi\h reading and 
several of -the biserials were very low. 
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(N8) Which*Fraction is Larger, Sites A and B 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 



Which is larger? 

1 
2 



rr or 



1 

7 



(Site B only) | or l| 



• 5 
1 



3 



or 



or" 



5 



5 

10 



(Site B only) 



O- or 1 
100 2 



(Site A only) 0.5 or - 
me A only) ^ or ^_ 



Site A 
Site B 



67 s 



So 



55 



75" 

V7 



£0 



5"7 



77 



I. U 



Lei 



<o6 

35 



7^ 

to 



V/ 



.trO 

.7/ 



?7 



Hi 

t 



67 



<?3 



.4/ 



b7 

,85* 



-57 

n 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



Site A 
Site B 



So 

.ft 

,*3 



><*■'/ 



'It 



A 90 
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(N8) Which Fraction is Larger 



Frequency Distribution 




Score 


% of stuSents 




csnp 


Nok-CSMP 


O 
1 


07 lo 


4 6 


2 


l! 03 


o£T Ok 






fl 18 




U 27 




S 


1 >, 1 







Adjusted Hems 


p-vtjue 


Site 


CSMp 


Non-CSMP 


°A 


3.3 


3.5> 




°B 


2.4 


1.8 





t t t 

Note: Sites A and B had different Sets of items 



Comments : 



-Like the previous scale dealing with decimals, the Site B scale was a repeat from 
fifth grade, with two items revised for Site A. 
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(Nil) „ Ordering Fractions and Decimals, Site A 



Test Items * . * 


• 


Percent 
forrect 
•t N 


Bi serial 
C N # 


i< 9 Fractional Decimal 

A number that Is larger than but $w11tr than "JT 0.6 1 

- ' "" ' * 

(Other items used this format.) L , - 

Form A , 4 

A number that larger than j but snail tr than |> 


9 

% 


- 

F/P 


•ffo / 


- 




A numbtr that Is largtr than j- but soallar'than 1.0 ^ 




"/if 


//.oo 






A number that 1s larger than 0.30 but smaller than 0.40 




31/ 




\ 


« 


A number that Is larger than j but snail tr than j 
A number thatSs- larger than ^ but snaller tytn 0.4 


% 


/3S 

•loi 
/<7 


*% ■ 






A nusber that is larger than 0.2 but»sma11er than 0.3 








•"/ft- 




A nuaber that Is larger than 0.42 but snaller than 0.43 




''fa 

' f 


Y>7(* 


/.o// e> 
Ay 


Form R 

1 U i III D 


A nuaber that Is larger than 0.4 but snaller than 0.9 












V 

A number that Is larger than j but snaller than g- 


"Ms 






J> 




A nuaber that 1s larger than 0.20 but smaller than f 










* 

V 


A number that 1s larger than 0.8 but smaller than 1.0 






.<?'/ 






A number that 1s larger than j but smaller than ^ 


/I8 




.8>L . 
/7<? 






v j 

A number that Is larger than 0.6 but smaller than y 




% 


I -oS/ , 


* 


C 

* 


A number that 1s larger than g- but smaller than 1.0 


//<? 


21/ 


* 


J»j / 


Number of Students 
' KR20 Reliability 


Form A 
Form B 

• 




*'/.*(, 






Mean Reading Score 






20.O 






Correlation: Scale and Reading 


. Zo 
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(Nil) Ordering Fractions and Decimals 



Frequency Distribution 



Griph of C1*S5 Hstns 




Score 


% of students 


0 


csr\P 




- 12 04 


<S 12 


! 

2-7 


01 10 

5fc 43 


04 11 


8 -15 
I* 




n 2* 
©2 ol 



Site 


Adjusted Means 


S . 

p-v»lue 


CSMP 


Non-CSMP 


A 


6.3 




* .02 



Comments : 



-This was a new scale. The particular items chosen were intended to be fairly difficult 
and the- mean percent correct across the 28 items was about 40. 



lxj 



1 © 

ERIC 



A93 



(N17) Fraction and Decimal Order, Site C 



s Test Items ) , 


Percent 
Correct 
C N 


Biserial 
C N 


/ 

» 

wot it i tr?* r 


> 








• 




(CftxU of*) 


23 


33 




.So 


(Other items 


followed this format) 














^9 








s 

4 


J " * 


a/ 


» 

35" 


* HO 






1.5 «r 0.51 


6*~3 


31 


/ a i 






«.Q1 '«r M 


3V 






'5*5" 


% 

i 


O.f or 0.111 ^ 


30 


ir 








0.5 or $ 






? ■ 


.21 


* 


1.75 or | 




U 




.01. 


• 




37 


\i 




•/s~ 


) 














/ 
L 






















Number of Students 






77 






KR20 Reliability 












Mean Reading Score 


> 




'57 






Correlation": " Scale and Reading 
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(N17) Fraction and Decimal Order 
(Student page is shown on the -facing page.) \ 

•» « 

t 6raph of Class Means 

I 




Frequency Distribution 



Score 


% of students 




CM 


M«-CSMf 


O 


01 




1 


o3 






35 






£0 




7 


OX 




8 


o3 





Httnr by Ability Ltvtl 





1 


2 


3 


r 


An 


CSHP 




3 1 




J* 


3.? 


Non-CSM> 






3. 3 


3/ 


3 6 


t-Sttt. 


.3 


. o 




A3 


3 



Comments,: 



-This scale was a new scale administered only at Site C, but was essentially a 
combination of items similar to those in N4 and N8. * There wpre 4 items* in cormion 
to the three sites.' The mean percent correct cm these four Common items were: 





CSMP 


Non-CSMP 


A 


78 


65 


B 


61 


35 


C 


27 


36 



Again the performance by CSMP students at Site B is very ?trfcng; but at Site C, the 
brief CSMP exposure did not help. r 
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(Nl) Decimal Gas, Site B 



Test Items 



Percent 
Correct 
C N 



Bise 
C 



rial , 
N 



1. Ptttr has 6.5 gallons. 
Thtn ht spills 1.2 gallons. 
How «jch gAs trill ht havt Itft? 



2. To« has €.5 gallons. 

* Ht buys 3.5 fort gallons. 

How tuch gas will ht havt thtn? 

* v 

3. John has S % .S gallons. 

Ht usts up four gallons. v " 
How ftjch gas will ht havt Itft? 



4. 6111 has 6.5 gallons. 

Ht buys ariSthtr half gallon. 
How ouch gas will ht havt thtn? 



5. 



Ron has 6.$ gal tons. 

Htxt wttk ht will ust un tints this touch. 
How auch gas win ht use ntxt wttk? 



Jot has 6.5 gallons. 

Ht sails tach gallon- for IZl 

Ho nuch aonty will ht get altogethjr? 



Ktn has 6.5 gallons of gas. 

Ht gives away half of 1t. 

How such gas will, ht havt Itft? 



9/ 



X8 



5~% 



3) 



V7 



39 



as 



39 



I) 



58 



lo 



10 



■f7 



/2 



.11 



93 



(,*} 



>73 



7/ 



Number, of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



t¥>S\ 



$7 

t 



(Nl) Decimal Gaj 

(Student page is shown on the facing page.) 

Grtph of CI us 




*dn-CS*> 

t-Sut.- 



Frequency Distribution 



score 


% of 


students - 








0 


00 


(I 


1 


of, 






to 












II 




7 


16 





fcwu by Ability L«vt1 



1 




f 3 


4 An 


V.7 




5.7 












I 3 






<?./ 




30 ' 


V.J 



Comments ; 



-This scale was repeated from last year where a similar large difference in favor of 
CSMP was found. . J 
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(N9) fractional Word Problems, Site B 



Test Items \ * 

n 


Percent 
''•Correct 
C ' N 


Biser 

c 


•ial 
• N. 


i 

Complete the sentences: > 










^ of * 40-pcind ofvdOQ food 1s pounds. 

* 






. OO . 


■ V/ 


i 

^ of i 2rfo^ofcoe book 1s pages. 


''(/fa 


3? 


. 3S" 


1 


i of i dozen tags 1s eoos . 


> 


•f 




■30. 


- j of « dollar is cents. t 










of i 3a-ounee bottle is ounces. 

» % - 




3? 


. Hi 

} 


• 0*0 




■ 








♦ 
















* 




/ 




















Number of Students , 
KR20 Reliability 

Mean Reading Score ^ 










V 

Correlation: Scale and Reading y 









o 
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(N9) Fractional Word Problems 
(Student page is shown on the facing page,) 

Graph of Class Htans 




Site 


Adjusted Means 


p- value 


CSMP. 


Noo-CSMP * 


B, 


2.4. 


1.6 


.05 



Frequency Distribution 



Score 


% of students 


>* 


csrw 




6 




21 


. 1 


25" 


26 


a 


It 








u 




<* 




i 


IS* 


6* 



Comments : 



-This scale was repeated' from fifth, grade. The performance by Non-CSMP classes seems 
. rather podr given the nature of the items (e.g., 3/4 of a dollar answered correctly 
by only 32% of the students). 
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0: Organization and Interpretation of Data Category 

> 

Only one' scale was used, in Site.B, and it was a repetition from the 
fifth grade 1980 study. 



01 - Weight Qraph |Site B) page A102 '| 



1 



A101 



(01) Weight Graph, Site B 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 



Sample. How «uch did BUI weigh at 12 years N o{ N «fl*? 



1. How much did Bill weigh at 8 years of age? 



2. How old was Bill when he reached 80 pounds? 



3. How much did Bill weigh at 13 years of ageV_ 



4. How much did B111 weigh at 2 years of age? 



5. How much did Bill weigh at 7 years of age? 

4 * 



6. How much did B111 weigh at 5j years of age? J_ 




7. How old was B111 when he reached 90 pounds? 



8. How old was B111 when he reached 50 pounds? ^y^" 

, > > 

9. How much do you think Bill wjjl welgfc w£en he oets to be 18? 

y 

10. For how many years Was Bill between 50 and 70 pounds? (Circle one) 
3^ 4 years 4j years 5 years 5j years 



91 



ft 



3o 



QS 



19 



9/ 



?7 



6>8 



/3 



? 



.5V 
>0>o 

'•69 



9j. 



-7? 



7/ 



*7 



>30> 



23 



62 



Number of Students 
•KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



6V 

JY>f 



?7 



3S~ 
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<0D Weight Graph 




(Questions are shown 
on the facing page. ) 



Srtpft of Cltss Muns 




Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP • 


B 


5.5 


4.8 


.03 



Frequency Di s<^ribution 



Sjetfre 


% of students 






Mw-CSrtf 


> o 


OO 

02. 


ofe- 






,33 




02. 




10 


OO 


oo 



feus by Ability Ltvtl 





i 

1 


2 


3 


4 


All 


CSMP 












Non-CSMP 












t-sut. 


4 


/.? 
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P: Probability Category 

Two scales administered at Site B were repetitive from' fifth grade, 
new scales were created and administered at'site A. 

PI - 100 Outcomes^. page A106 \ 

P3 - Which Box ; . , A10 ^/ Slte 8 x 

P4 - Dependent Outcomes AU0\ 

P5 - Conditional Probability A112/ t-? 

\ ' 

f 

t * 



\ 



A105 



(PI) 100 Outcomes, Site B 



mm — r 

Test Items 


_ Percent 1 
Correct 
C N 


Bi serial ' 
C N 


• 

(A range ot answers was 
allowed for a)-d), i.e. , 
for (a) 11-13 was counted Same ] 
as correct, for (b) 14-16, 
and so on. But students 
were not told a range was 
a$$wab1e.) 

• 


. <fc6!oxk 
MloKftc 

b<M*i kc 
ate 

It loo -W k*K. 


7\ 

3t 
2\ 

23 

so 

2% 
40 


"fi- 
ll 

11 

SS 

30 






Game 2 

S 


a) Slack 

b) wkite 

c<b 

ar3C 

K - 3d 


US 

35 

50 

it 
Ci 
st 
si 

2t 

• 


22 

H-7 
11 
I* 
-71 

2C 
26 
52 






Game 3 

ft 

s 


*<c Mc 
a~-b 


1 

i 

CO 
ik> 
3o 


% 
fS 
2C 
42 
*l 






Game 1 

If you want black to win, which game should you play? 

(Circle your- answer) 6ame 2 

Game 3 


1 




• 




Number of Students 




i 








Mean Reading Score 




i 

113.9 


15-0 






Correlation: Scale and Reading 




H& 
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(PI) lt)0 Outcomes 



i. 



Jot plays tht ftnt wit* ntrtlts mi a bag. 
ttt~t1o*ts his tyts'tnd takts a narblt out. 
frhtn ht nuts It fcac*. 

SUPPOSE JOC rUU£0 THE W« 100 TINES 

About how m*ny tints would ht jtt a black narblt? 

About how nany tints would ht got a white narblt? 

About how nany tints would ht 9tt a shadtd narblt? 




About how nany tints would ht gtt a narblt that 1s not white? 



2. 



H* plays tht turn gam with dlfftrtnt ntrblts. 

SUPPOSE JOE PUVED^TNE W€ iOO TIMES 

About how nany tints would ht jtt a black narblt? 

About how ntny tints would ht got a whltt narblt? 

About how nany^lnts would ht got a shtdtd ntrblt? 




Vbout how misy tints would ht gtt a narblt that Is white or shadtd? 




Jot plays tht gut by spinning tht splnntr. 

SUPPOSE JOE PLAYED THE QUC 100 TINES 

About how nany tints wnwlf 1t taint tt tht black part?. 

About taw may tints would It point to tht white part? 

About how nany tints would 1t point to tht shadtO part? 



Frequency Distributor! 



Graph of Class Means 




IScore- 


% of students 








o 


OS 1 


05 




3o 




s "\ 
t iohH 

15- U 


25 
IS 
13 


"51 

3 


• 3* 


03 
oS" 





fetns by Ability Uvel 





1 


2 


3 


4 


All 


CSMP 


?</ 






*T ? 




Non-CSK» 








Ce.tT 




t-st»t. 


-* 




.7 







Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


8 


9.0 


9.1 





_ -Non-CSMP students improved somewhat from their fifth grade performance;. CSMP 
f students -very little. 
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(P3) Which Box, Site B 



Test Items (See facing page.) 



Percent 
Correct 
C N 



Bi serial 
C.N 



6 
© 

© 

cd © 



0 G 



0 
0 
0 
0 
0 



0 0 0 
0 0 6 
0 0 6 
Q 0 e 



CiflLHJffiUJ9LfiSBB7 



0 
0 



e 

© 

e 
e 



e 

0 © 

0 © 




e 

0 6 

0 e 

© © 



0>7 



0 


© 


0 




0 


© 


0 


© 














© 












■ © 


1 




6 






© 


© 




© 




0 


0 © 


© 




© 




0 


0 © 


0 6 




0„ © 




0 


0 © 



5*7 







0 




0 


0 0 © 




0 0 © 




0 0© 



01 



!93 



99 



. ^3 



5"/ 



7? 



,V7 



/.CO 



So 



• *3 



<?3 



Number of Students 




7<3 


57 


KR20 Reliability 








Mean Reading Score 




/$•<? 




Correlations Scale and Reading . 


* 


•33 
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CPa) Which Box 



Pretend: Sh*ke the box. 

Close your eyes. 
Tafct one ball. 



SAMPLE 

o 

o © 
o© ® 



WHICH BOX WOULD YOU CKOOSF7 



) 

MONDAY 



t 



© 



© 
© 
© 
© 



© 
'© 



© 






© 


© 




© 


'© 


© 




© 


© 


© 




© 


© 



Frequency Distribution 



Score 


% of students 




CSM 




© 


II 




i 


Oft 








21 


5 


15" 


II 




3| 


20 



Mams by Ability Uwl 





1 


z 


3 


4 


ait 


CSMP 




s.o 




3.s~ 




Kon-CSMP 


¥V 




3.0 


a.o 




t-sut. 


Ax. 


•3.3 










Comments:. 

-The CSMP advantage was due 'mainly to one very low scoring Non-CSMP class. 

-The frequency distributions were somewhat U-shaped; many students got no more than 
one correct but also many students got all six correct. 
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(P4) Dependent Outcomes, Site A 



Test Items (See facing page-} 



(These items were scored 
for the exact answer except 
for the last item which was 
scored for a range of 5. ) 



Form A 



ii. 



Form B 




II. 



Percent 
Correct 
C N 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



2C-0 
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(P4) Dependent Outcomes 



Rules 



Spin 2 spinner*. 

Add together the numbers the 2 spinners point to. 
You win 1f they add to 15 or more . ' 
Play the game 100 times. 



I? you played with these spinners: 



How many times do -you think 
you would win out of 100? 




II, 



^7 / VS 

Rules 

Spin 2 spinners. - 

You win 1f Spinner A points to a larger number] than Spinner I 

Play the game 100 times. 



If you played with these 2 spinners: 
A B 



How nany times do you think 
you would win Out of 100? 




6nph of CI us Mi ins 




Frequency Distribution 



Score 


% of students" 


0 








ft a 


II 65 


it 11 


1 

x-s 


it n 


2z n 

Mi *> 
15 l\ 


(f 


OO 06 

oo oo 


oo oo 
00 00 



— i 

Site 


r 

Adjusted Means 


p- value 


CSKP 


Non-CSMP 


A 


5.4 


4.0 


.01 



ERIC 



' -There were five Items where It could be deduced that every result would be a win (or a loss)- for examole 
the sp.nners In he third Item had to point to nunfcers which added to at least 15 The mean 'percent correct 
for these four i^ems were 74 for CSHP versus -53 for Non-CSMP. percents correct 

pTSi^lf/S T2l\T^ effect (, - e -' vefy few answers *^ s,xth ,tem ^t r : d a tt^!r 

"If^LT » 6Ve ? ° the L l temS , 1n ^ Ch . m]y one sp1nner ma «ered, for exanple the seventh Item where the result 
§J for C^ t ve^r 2 r 8lort~CsS ether ^ " ' ^ * ^ M « ^ ™ corrjct'were' 

"Jpper'wu'h'lower 31 ^ * t0 ^ ^ ^ " PPer nW * erS and the l«er 'miners but not 

Am' Vj 



(P5) Conditional Probability, Site A 



fest Items (See facing page.) 

± : 



Percent 
Correct 
C, N 



Bi serial 
5 N 



(Cotinon to Both Forms) „ yQU p]ay }QQ times _. 

^ Game 1 How t 1f *s do you think you would get 4? j 

0 

(See next page) 

How many tines do you think you would get 5? _ 
How nany tines do you think you would get 6? _ 




How many tines do you think you would get 6? . 
How many times do you think you would get 7? . 
now many tines do you think you would get 8 7 - 
How many times do you think you would get 9?- 



How many times do you think you would get 6? 



Form B 
Game 2 

(See next page) ^ wny Um% d0 you th1nk you ^ uU get 7? 



How many times do you think you would get 8? 



(These items were scored with a range of 
allowable answers, i.e., 45-55 for item 1.) 



is 
$2 



I Co 
PC 

v; 



43 



a 


CI 


LLLf 


if 


.1/ 


.ci 




.51. 










'7 




• ¥0 




. /7 


>/o 


6~.3 




't>7 



,V6 



Number of Students 
'KR20' Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



Form A 
Form B 



03 



7£ 

30<0 



(Ac 



35- 
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(P5) Conditional Probability 



Frequency Distribution 



Rules to pity Same 1. 



1. * First spin this spinner V T J 

2. Then: 1f you get At s^n Spinner A 



OR 1f you get B, spin Sptnotr B 



m. 



Rules to play game 2 



1. First spin this spinner 




Score 


t of students 


0 

i 


csnp 4 








o* 07 

0! 01 


02. 
04 o3 


r-u 

IMS 


so m 

55" 5b 
OS oo 


50 *3 " 

VJ So 




oi X 


, 00 X 



2. If you get A, 
spin Spinner A 



OR 



1f you get B, 
spln^plnner B 



OR 



1f you get C, 
spin 'Spinner C 






Graph of Clasr Mtans 




Adjusted Hems 



CSMP 



6.0 



Non-CSHP 



6.1 



p- value 



Comments: 

-A range of answers was allowed for each Item. ^ 

-In Game 2 of Form A It was Impossible to get 7 because Spinner C could never be* "chosen". Only about half 
the students got this answer right, a possible Indication of the, task being misunderstood. In fact all 
four questions of this game were poorly done. 

-Although the student page Is shown, the scale was scored for additional Information, 1.e.\ whether the percent 
given was greater for 4, than 5, for. a total of 19 possible Form A and 15 possible Form B. The frequency 
distribution shows the range of students' answers. 
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R: Number Relations Category . > 

Three of the scales Rl , R2 and RS were either repetitions or revisions 
of previously used scales. R6 and R7 were new scales, 

Rl - Solving Number Rule? page^Al 16 Site B, repetition from 5th grade. 

1 1 1 

Rl - Solving Number Machines A118 Site C, revision from newer format. 

(Different formats of \ame task) \ V 

R2 - Using Number Madhvmfs A120 Site B, repetition from 5th grade. 

R2 1 - Using Number Machines A122 Site C, revision of items of R2. 

R5 - Labelling Number Lines A124 Revision of items from previous 

scale. Sites B and C. 

R6 - Colored Squares .' . . .A126 New-All Sites. 

R7 - Dependent Relations . / . . A128 New-Site A. 



v A115 



(R>) Solving Number Rules, Site B, 



Test Items 



Percent 
Correct 
C N 



Bi serial 
C N 



a 

T 



12 



30 



4« 



a . an 

[too 304! 



10 34 j 



a 



T 



15 



30 10 



a 



36 



6 



100 



SI 



13 



12 



7? 



7<p 



"5T 



26 



46 



I.I 



7ff, 
</4 



5 • 



10 |4 



IZ 



So 

36: 



51 

y 



2<? 



6_ 
T 



5*1 



5-3 



£7 



5-7 



."9/ 



67 



s4 

7? 



/7 



.75^ 

.6; 



V6~ 



*7* 



^3 
3? 



57 



•7V 
•3V 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



*7 
.76? 
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(Rl) Solving Number Rules 
(Items frqm the student page are shown on th^ facing page.) 



Frequency Distribution 



Score 


% of students 




CSflf* 




0 






\ 


05" 


10 




\1 






3& 






li 




8 


IS 





Comments : 



firaph of CI us Htens 



fctns by Ability ttvtl 





1 


2 


3 




All 


CSMP 






v.? 






Non-CSMP 








.3, 7- 




t-Stit. 


1.0 


*-?.^> 


A 9 


-V./ 






-For the two Number Relationships scales administered at Site B (this one and 
R2, paqe A121) both CSMP and Non-CSMP students improved by about 50%. In both 
years, the CSMP advantage in this category was significant. 
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(Rl 1 ) Solving Number Rules, Site C 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 



Om MIV|\ 
MM mt i 

Form A " m "-' • J 



KMIA'S W< 



Form B 





Cut 

H1t> 




rim ti«it 


i 


II 


UfM «1m- 


1 


M 


Tfclt* cIm' 


• 




•mmi*m 


} 


□ 



/ 



41mi i j 

tMM «|MI 1| u 



/7 



Qui Aw' 

mm. 

N «ln. M • 
Imj««1m. | 9 -|| 
TMn cIm- ^t* f 
•-nit*' Q , 





HM'l 








On* 








M««l 






Mnt «1m. 


t.l 


1 J * 




Imn «1m 




1 




TMn (Imi 


7.7 


M 


«u« 




I.J 


□ 





a Ml Htar'i 

4 • 



or 





Mrs 


UK — 




Qmi 

U1«t 




Mm «Imi 


1 


a 


Ihm «1m< 


• 


* 


f*r« «1m: 


« 


rt 




□ 





Out fmi 



*7 



(One item in Form' B was not 
scored because of an error 
in the item. ). 





1 1.1 




1 • I 


«!«•: 


4.1 S.4 


tNrttw: 

* 


■*□ 




MjL f f IMC- 




Qmi h» 




MK. JMJi 


tint (Imi 


• 4 




4 • 



0*7 



r 4 



11 



-3? 
,5a 



0-T 



,7V 

,33 



to 



.7/ 



.(pO 



CO 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and ^Reading 



Form A 
* Form B 



9s 
15.% 



97 



9 

ERJC 



( R l )- Solving Number Rules 

(Student page is shown on the facing page.) 

I 



Frequency Distribution 



Scrfre # 


% of students 




csn? 




fo^vA B~ 




38 S\ 


MO W 


t 

l 


38 "51 

n o? 
oif o3 


oo oB 


5 


02 oo 

0\ * 


ofc oo 
of *f 



MeansTSy Ability Level 




1 


2 


3 


4 


An 




OS 


10 


0-7 




/./ 




oq 


o.C 






-o.9 




.^5 





Site 


Adjusted Means 


^p^value 


CSMP 


Non-CSkP 


C 


0.8 


0.7 





-The format and instructions were somewhat different from those of the previous 
• scale (Rl) and were .changed to make the task simpler. However, on the five common 
items the mean percents correct at Site B (Rl) were 61 for CSMP versus 46 for 
Non-CSMP; at Site C they N were only 28 and 30. It's hard to explain the Non- 
CSMP difference between sites. 

-The preformance on the fraction and decimal items was extremely poor. 
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(R2) Using Number Machines, Site B 



Test Items 



Percent 
Correct 
C N 



Biserial 
C N 




97 



ML 




7S 




6>? 




a/ 



9/ 



<?7 



S5 



OiT 
3? 



6/ . 

n 

0(e 



33 



ITT 



S2 
(*2 



7& 

•G>3 



3D. 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



0>V 
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(R2) Using Number Machines 
(Items from student page shown on the facing, page. ) 



Frequency Distribution 



Score 


% of students 








0 
1 


'00 

ox 


, 03 


*■¥ 
5-8 


32 
55 




10 


08 
. o$ 


oi 
00 



Means by Ability Level 



ERIC 



lph of CI ass Hatns 



A121 



CSMP 
Non-CSMP 
t-Stat. 



1 


2 


3 


4 


All 










£~? 






V- 3 


3. 2. 


V-b 


1.0 






/./ 


3.3 
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(R2 1 ) Using Number Machines, Site C 




Number of Students ^ 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 



Form A 
Form B 



er|c" 



3o 


it 












to 




>n 




■(el 


lb.\ 





3</ 



A122/. 



13 



0 



(R2 1 ) Using Number Machines 
(Items from student page shown on the facing page 



s 



Frequency Distribution 



Score 


% of students 




csr\P 






Potn* ft 


A R 
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' 10 07 


13 -11 




W 25 








3* 3o 


3 


04 14 


0? 14 


H 


02 a 


60 0^ 


■ 6 


06 04 


ot o3 


4 


00 06 



00 o( 



H»an$ by Ability lav«1 



Graph of CI 455 Mtans 






1 


2 


3 


' 4 


All 


CSMP 




2-1 


/• ? 


A3 


/.£ 


Kon-CSMP 




3.6 


/.7 


A3 


/? 


t-StJt. 


v 




• 3 


'3 





Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


C 


1.7 


1.8 





Comments : 



-On the five items common to this scale and the last one (R2), the mean percents 
correct at Site B were 66 for CSMP versus t 52 for Non-CSMP; Site'C they were 43 
and-44-r— _ 

-Performance on the fraction and decimal items was very poor* 

-The reliability for Form A was very low, probabrly because Form A was so much 
harder than Form B (see aiso.the frequency distributions). x 
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(R5) Labelling Number Lines, Sites B and C 



Test Items 



Form A 



Sample 



Form B 



Sample 



H \ 1 i 

■ 6 

1 1 1 1 1 1 


— 1 — 

u 


1 1 
« U 


1 1 - tt » 
-f 1 1 ■* 1 


r 


1 h- 

o 




— i — 

M 


■ i 1 


-J » 1 1 i 


1 


1 K 

o 


i 1 I 1 \ h- 



6 * 



I t T*- 



. 6 



4 4 



H 1 i 1- 



>•> tt.i 



H 1 1 1- 



Percent 
Correct 
C N 



it? 



to 



«7 



12 



01 



-s ■ 1 — t 



□ 



H -! 1 h 



^ ! 1 h 



•i h 



4 h 



H -4— 1 h- 



— h- 
a 



"S — S — 



H h 



r 



H +- 



1- 



Q°l 



7/ 



6"/ 



^>7 



34 



1 1 



3f 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 
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96 



7<> 



57 



43 



/3 



7S 



7o 



79 



/o 



'9 



n 



34 



T5T 



1L 



Bi serial 
C N 



•03 
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•3/ 



6>3 
. 1 3 



2? 

'"" .33 



3a 
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.*3 



• 00 



> J / 
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•3/ 



J/ 



33 
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3<f 



•36 

.30 

.S/ 



./o 



33 



0$ 



>SiT 



(R5) Labelling Number Lines 
(Student page is shown on the facing page.) 

Graph of Class Haans 




Frequency Distribution 



Score 


% of students 
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Site B 



feus by Ability Level 





1 


2 


3 


4 . 


All 


CSMP 




3.2. 


Q-if 


/.? 




Aon-CSMP 


3 0 




a-V 




a. a 


t-Stat, 
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Site C 



Means by Ability Level 
/ 





1 


2 


3 


4 


AH 


CSMP 




«?. / 








Non-CSMP 




S-5- 




I In 




t-Stat. 


■ / 


/•5* 






• l 



Comments : 



-It is hard to explain the higher scores in Site C for Non-CSMP students for Non- 
CSMP students in Site B. 
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(R5) Colored Squares Site A, B, and C 



Test itc«s (See facing page,) 



Percent 
Correct 
C H 



81seH«1 
C n 



Percent 
Correct 
C N 



Site B 



BlserUI 
C n 



Sit* C 



Percent 
Correct 
C N 
— * 



B1 serial 

C N, 



90th squtrt 
91st squirt 
92nd square 



About how many of the first 100 squares will be white' 



It 7? 



,*6 .37 
31 .36- 



5*3 03 
57 

3(c $V 



'/(* V? 
.27 .20 

,22 • '/ 



4 / £>~3 



.24 ./6 
•3/ .32 
.3/ -22 



C 



90th squire 
91 th square 
92nd square 



33 



About how many of the first 100 squares will be white' 



SO 27 



.23 .38 
.3i 37 

.3£. 37 
.ft ,40 



j 

si 



i 

i/O 0 £ 



.3* -3^ 




i 2 5 *f H loi 1 liU 



36th squtrt 
60th squtre 
65th square 



7S 7y 



• 23 

.23. -3/ 
3/ .33 



K<7 ^ 



,67 / 57 



£ 7 .5? 



.2-7 ./? 
•a/ ,33 



fc£ U fcl W 41 76 II 71 



1st square be? 

5th square be 

101th square 

105th Square 
» 



3b- o?? 
V«2 J? 



•id? ./7 



./;? .3i~ 
,65- ./V 



\J3 Of 

i 

I 



. 55" ./J 
t<?7 



i , i 



Which answer shows what the 75th, 76th and 77th squares will be' 
Whicn answer shows what the 152nd, 153. and 154th squares will be? 

(See n£$t page. ) 



• (*/ 

• 37 .32 



3/ // 



~c*J .3i" 



<3V .^7 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 
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(R6) Colored Squares 



Frequency Distribution 



10 11 




¥ut coUr will tht 90th squirt b«? blick «hitt 
¥«t ctlor will tht 51 jt squirt b«? blick wMtt 
*»X ctlor win tht 92nd squirt bt' blic* wilti 
Afcout hew nny of tht first 100 squirts will bt wftltt? 



(and so on until the last item) 





_J «_ 1 f T t t !• n tt t* t. 




1 ■ 






■ 


1 ! 



tt »"«te» m». rtomffo Mama *U k? 
?i n rr _ n n t 



^ 1 



« I C 4 



Score 


2 of students 


o 


csrtP 




0| 0( o( 


A & C 
01 6| 61 


1 

2-8 


06 00 Oi 


01 00 0| 


tc-n 


n IS 

|1 oo oo 


3/ IS 

*1 £)0 w 



Site B 






Adjusted Means 




Site 


CSMP 


Nof>-CSK> 


p-Vilut 


° A 


10.5 


9.4 


.05 


°B 


7.2 


7.1 




A C 


6.4 


5.9 


.30 



Aims by Ability Uvtl 





1 


2 


3 


* 


All 


CSK> 




7 ? 




7(5 




«on-CStf> 




7. 9 




TO' 




t-Stit. 




■o 








ite C 


Nitns by Ability Uvtl 






1 


2 • 


3 


4 


All 


CSMP 


T4 


u 








Aon-CSJ* 


4* 






sn 




t-Stit. 


\.1 


•1 


•5 







-For the second and third patterns, students at Site A didn't do much better (or 
did worse) than students at the other two sites (though they were much higher in 
ability). It may be that the strategy of si.mply matching the one's digits was 
used; it happens to work in these two patterns— but not in fourth pattern, where 
Site A did better. 
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(R7) Dependent Outcomes, Site A 



Test Items 


• Percent 
Correct 
C N 


Bisenal 
C N 


Sow boys pliyed I g*w. Everyont 9ot it Ittst 2 points. There were no frictions. 










A 90t three tlws IS wny points IS C. 








J 


1 got helf IS wny is C 










C got 2 sort polntjs then 0. 










i got hilf is wny iTTTx 










F oot core thin twice is (wny is 0 md Itss thin twice IS wny is C. 










Who won the gew? ^ 
W*o w*s second? 


?S 








Who mis third? 

i 


■ 


90 




■ sy 


Who wes fourth? 

Uhn mac fifth? 

Who wis list? 

All Correct 


CfiU 
3S 
Iff 


0>Q 
do 
-/<7 


• at 
,7/ 


. 3? 


Suppose A got 18 points - * " 
How wny did C get? 




h~ 


/&> 




How wny did £ get? 


Si 


32- 


,Cfi2 




How wny could F hive gotten? 

(Give ill possible inswers) 

(Scored if students wrote 9, 10, and_ 11.) 

Suppose t got core thin 5 points md 8 got less thin 10 points. 


OV 


0? 






How wny could 0 hive gotten 

(Give ill possible inswers) 


. 01 


OX 


./? 


• // 


* ■* 

(Scored if students 
wrote 12, 14, and 16. ) 


j 


< 






■ -i 
Number of Students « 


/.?</ 








KR20 Reliability 




.13 






Mean Reading Score 










Correlation: Scale and Reading 


•37 







(R7) Dependent Outcomes 



(Student page is shown 
on facing page. ) 

Grtph of Clm Hews 



Frequency Distribution 




Score 


% of students 








o 




k o% 


I 


02. 


o"3 




*7 


4-1 


5-7 








10 






02. 


o4 


10 




00 



Comments ; 



-This scale required students to organize a set of data in which paifwise relation- 
ships are given. The problem lends itself to, but does not require, the use of 
an arrow diagram. 



11, 
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J 

C U: Elucidation Category 



U3 was in the same format as 111 , i.e., a set of problems, for each ^>f which 
students were to list as many numbers as possible which fit the "stated criteria. 
U3 was merely a revision of Ul , using different problems. U2 was a new scale, 
though it could also be thought of as merely one more new problem, albeit more 
complicated than any of the individual problems of Ul and U3. 

Ul - Elucidation page A132 Site B-Repetition from 5th grade. 

U2 - Rules for Getting to 12 A134 Sites A and B. New. 

U3 - Multiple Answers A136 Sites A and C-New problems, but 

repetition of the format of Ul . 



AT 31 
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(Ul) Elucidation, Site B 



Test Items 



Percent 
Correct 
C N 



9 

ERIC 



Spin both spinners at the same time. 

Your score 1s the total from the two spinners. 




what are the 'possible total scores? 25. ( 5 other pos s ible correct answe rs) 



Start at zero. 
Counting by? 
End up at 24. 



what could you be counting by? i, (7 other possible correct answers) 



Close your eyes. 

Pick out three balls, f Cl) 
Add to get a total scor^. 

what are the possible total scores? 52 t (6 other possible correct angers) 




Multiple of 2, 
Multiple of 3 
Smaller than 50 



(7 other possible 

For what numbers are all three statements true? 24, correct answers) 



r 



Mean score out of 25; 



'3-3 



Number of Students 

Mean Reading Score 
Correlation: Scale and Reading 



(r3 



Al ]2j 



0 



(Ul) Elucidation 



(Student page is shown on the facing page except 
that students were not told for each problem 
how many answers were possible.) 



Gnph of Cliss Huns 



10- T: 



tint 






Adjusted Hems 






Site 


CSMP 


Non-CSHP 


p-value I 




15.3 


11.9 


.10 1 


■ 













Frequency Distribution 



Score 


%> of students 








0-2 




Ofc 


3-5" 


o3 


0<\ 






2t> 




"SO 




11 -2{ 




7t 


2V§ 




0* 



fetns by Ability Ltvel 





1 


I - 


3 


4 


ait 


CSH> 


QO.O 


'7.2 








Non-CSMP 


(f.l 


sr.? 




JO./ 


//. 9 


t-Stit. 




.& 


S. 3 

- 




j./ 



Comments : 

-This scale was repeated from last year. 
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(U2) Getting to 12, Sites B and C 



/ 



o 

ERIC 



Test Items 


Percent 
• Correct 
C N 


Rules 








1. Always start at zero 






/ 


2. «0nly use these numbers: 2, 3, 5 


, 7 






3. Only use these operations: *, - 








4. Always end up at 12. 






• 


* 

Solutions 




• 




Start at zero, +7, x2, -2 








Start at zero, +5, +3, 4-2, x3 


















etc. 








Mean: number correct minus 


number wrong 








Site B 


"5.1 




* • 

> 

L 


Site C 




IS 


Number of Students 


Site B 








Site C 


Vo 




\ 

Mean Reading Score 






>$ 3 

/S"./ 


Correlation: Scale and Reading 




-Bo 


.0/ 



A134 



11. 



(U2) Getting to 12 



Frequency Distribution 




Score 


% of students 




csnp 




B C 


— B S 


„ 6 
1 


lo 15" 
lo 13 


'** 31 
jo [6 


1-3 
4-5 
irl 


V\ 27 
28 21 

» <"* 


i« a? 

It IS 
02 o2 


1 


0*| OO 

ot o| 


00 02. 

oo o\ 



feans by Ability ttvtl 



Site 


B 


i 


"^2 ' 


3 


4 


All 




CSH> 




</-7 










Hon-CSMP 








.7 


Af 




t-SUt. 














Site 


C 




Means by Ability Level 








1 


2 


3 


4 


All 


CSMP 




cp?. 7 


¥- 






Non-CSMP 




/■5* 




/■ 7 


/■r 


t-Stat. 


■ 0 




II 
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(U3) Multiple Answers, Sites A and C 



Test Items 



EMC 



Spin all thrtt splnntrs at th« urn t1i 
Tour scort 1$ tht toUl fro» all fchrt t spln ntrs* 



Mean 

C 


5 co re 
N 


KR20 


Frequency 
Distribution 


Site A 
C 


A 

C 


A C 


CSMP Non 
M C C 




What art tht posslblt total scort*? eg. 625 

(Maximum- number possible 11) 




Start at xtro. 
Count by io*» nutotr. 

end up at m. (Maximum number possible 11 

What could you bt counting by? eg. 5 



Clost your tyts. 
Pick out thrtt balls. 
Add to gtt a total J cor*. 

What art tht posslblt total scorts? eg. 93 

(Maximum number possible 9) 




feltlplt of * 
ftjltlplt of 3 
Smaller than SO 

For what munbtr* art all thrtt stattwtots trut? 

(Maximum number possible 7) e 9\^ 4 



9.3 
4.9 



6.8 
4.6 



6.6 
3.9 



4.6 
2.5 



Digits Must add to 5. 
SttMff 200 and 1000 

What art tht posslblt m»btrs? e g. 311 

(Maximum number possibl e 9) 



Number of Students 
Mean Reading Score 
• Correlation: Scale and Reading 



3.6 
1.2 



8.6 
3.7 



.95 
.91 



.93 



.5 
4.7 





.80 


.67 






,.49 


.45 



6. 



0 

3.5 



3.1 




124 

168 
20.0 
15.8 



,.85 
..78 



,83 
,84 



0 
1 

10 
11 



10 
36 

02 
13 

03 
05 

87 
26 



17 
si 

02 
21 

w 
05 

78 
17 



0 08-08 

1 '00 04 v 

10 08 05 \l 

11 01 01 01 00 



06 08 
02 05 
00 



,88 
.75 



,85 
,76 



.89 .90 
,70 .75 



136 

157 
20.0. 
15.1 
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.30 



34 



0 

V 

9 



10 


09 


27 


38 


00\ 


03 




11 


33 \ 


25 


09 


09 


34 


23 


05 


— aw 


14 


34 


31 


37 


)7 


10 


27 


24 


52 


26 


10 


06 




76 




77 


04 


12 


28 


22 


14 


02 , 


00 


01 



(U3) Multiple Answers 



(Student page is shown on the facing page. 
Samples of correct answers as shown, appeared 
on the student pages but maximum number possible 
was not shown to students.) 



For convenience, partial 
frequency distribution is ' 
shown on the left hand page.' 



6r«ph of Class Mews 



Site C 



Means by Ability Level 






1 


2 


3 


4 


All 


CSMP 




[(,. 1 




9-3 


1 3.io 


Non-CSMP 




in 




lo.Z 


1,3 3 


t-Stat. 


-<> 


-.if 




--2 


.-I 



Site 


Adjusted Means 


p- value 


CSMP 


Non-CSMP 


OA 


29.7 


21.0 


.01 


&C 


13.4 ' 


12.4 


-r 



"ea^h proMem^" 6 ^ ^ Separate P roblem and a ^ given beside the data for 
» -The time factor may have affected students' scores on the last items. 
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W: Word Problem Category 

\J The list of scales, below, is self-explanatory except for scale W5. That 

scale consisted of miscellaneous, interesting-looking word problems, often with 
• a strong component of logical reasoning. It was used at all 3 sites 4 *, but the 
items differed slightly from site to site so the scale scores' from the 3 sites 
are not directly comparable. 



W2 - Two-Step Word Problems page A140\ 

„_ /Site B. Repetitions from 5th grade 

W3 - Three Step Word Problems A14^ 

W5 - Miscellaneous A144 New-All. Sites. 

W6 - Amount of Information A148 New-Site A. 



,.(W2) 2-<$t«p Word Problems, Site B' 



Test Items 




Percent 
Correct 
C N 


Bi serial 
C N 


1. 


Shirts cost $10 each and ties cost $5 each. 

Peter bought 2 shirts and 3 ties. c 




V 




i 




What was his, total cost? 




.53 






2. 


Joan starts with $40. 
Each week she spends $2. 


* 










How much will she have left after 5 weeks? 




0 7 


79 


.6/ 


3. 


The cost of gum is 3 pieces for 1Q<. 










- 


How many pieces can we buy for 40£? 




era 
O 1 






4. 


Pam gets 50c each week. 

She always spends 30£ and saves the rest;. 










> 


How much will she save in 4 weeks? 


cc 

3D 


H3 


.13 


<? 12 


5. 


On Saturday Any and Susan made $13- selling lemonade. r 










> 


On Sunday they made $5. ~. 
They put their money together and' divided it evenly. 








<» 




How much did each girl get? 


\oS 




HA 




6. 


Jim has $10 in his bank now. 

Each week he will add $5 to his bank. 




* 








In how many weeks will he have $30 in his bank? 




33 


SO 


.hi* 


> 

7. 


John has St more than Tom. 

Ann has 3t less than Tom.* * ( 






■ 


m 
W 




i t jonn nas cu( , now mucn uoes Mnn nave : 




JO 


• lL i 




Number of Students 




3? 








» 

KR20 Reliability 




■ S3 






• 


Mean Reading Score 


• 


'</ 3 




» 




Correlation: Scale and Reading 


f/ 3 
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(W2) 2-Step Word Problems 

(Student page is shown on the facing page.) 

Criph of Out fewts 




Frequency Distribution 



Score 


% of students 




CSM 




€> 


11 


Of 


1 


og. 


15- 




21 


32 




21 


U 


4 


IS 


°? 


1 


13 


01 



Site B 



CSMP 
Non-CSMP 
t-Stat. 



Means by Ability L^vel 



1 


2 


3 


4, 


All 








1-0 


3-1 






I.* 




1.9 






3-5" 


-1.3 


51-7 



0 

ERIC 
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(W3) 3-Stage Word Problems, Site 8 



* 

Test Items 


Percent 
Correct 


B1 serial 




C 


H 


C 


N 


1. Shirts cost $10\each and ties cost $5 each. 










Altogether Joe spent $35 for shirts and ties. 










Ht bought 2 shirts. 








1 


How many tits did he buy? 

• 






.3* 


.5*5 


2. Joe puts boxes into piles. 








- 


Each box Is 1/2 foot high. 










Each pile Is 5 feet high. 










How nany boxes does he need, to make 3 piles? 


n 


°i 


3. Bill loads 6 boxes 1n 2 hours. 










John loads 4 boxes 1n 2 hours. 










Together, how many boxes do they load 1n 6 hours? 


1 1 


1 A 


.01 




4 Mxrv his d irnm mrfelec fh»n pmtm 
~. rim i j ti%+ ^ nurQ wi vici wioii rc be. 










Ptte has 2 more marbles than Lisa. 










Lisa has 3 more marbles than Ed. 










If Mary has 20 marbles, how many does Ed have? 

• 


a* 


/9 


.55, 




5. Monday, Tom ran 13 miles. 










Tuesday, he ran 8 miles. 










Wednesday, he ran some more. 










His average for the three days was 10 miles. 










How man* wiles did he run on Wednesday? 




r 


1.02 


.10 


Number of Students 


a*/ 


V3 






KR20 Reliability 




.si 










Mean Reading Score 










Correlation: Scale and Reading 






; 
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(W3) 3-Stage Word Problems 

or 

(Student page is shown on the facing page.) 



Graph of Glut ferns 




Frequency Distribution 



[Score 


% of students 




csrtr 




0 


a* 




t 


4-0 


33 




IS 




3 


ol 




4 


03 


06 


5 




02 



Nuns by Ability Uvtl 





1 


2 


3 


4 


ait 


CSMP 




/s 






0 


Non-CSMP 








.7 


1-0 n 


t-sut. 




1 2 


-.V 


•7 


•* 
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Word Problems, Sites*A, B, and C. (Form A) 



Test Items 



Percent 
Correct 
C N 



B1 serial 
C N 



Form A 



(— indicates items were not administered at this site.) 



Every chess club member played every other member Just once. 
After a new member, joined, 8 wore games had to be played. 

How many neuters are 1n the club now? 



20 
16 
12 
9 

8- 



36 
A/ 



V3 



/-2T 



Jose has 300 stamps 1n his collection. ») ]00 

If one-third of the stamps are from Canada, how many are from Mexico? b) 150 

c 200 
d) 



Can't tell 



43 



VP 



o<7 



Steve has 7 bills. 

Some of them are SI bills and some are $2 bills. 
Altogether he has $10 In bills. 

How many $2 bills does he have? 



i) 2 

3 J 

d) 5 



U9 



,o4 



In ring toss, you set 25 points for each ring on_ the peg 
but you lo e c 10 points for each ring off the peg. 
When Bob pTayed, the wind blew two of HT? rings off the peg. 

How much did his score go down because -of the wind? 



a) 20 
b 30 

c) 50 

d) 70 

e) Can't tell 



00 



•IS- 



OO 








Three-fourths of Tim's field 1s planted 1n com. 
One half of the corn 1s sweet corn. 

Unit portion of the field 1s planted 1n sweet corn? 



a) 3/2 
b 3/8 
c 1/2 
d) 1/8 



i3 



If 



3r 

if 

if 



In Mrs. Jones' class: 

'2 students wear tennis shoes 

18 students wear glasses. 
9 students wear tennis shoes and glasses 
3 students don't wear tennis shoes or glasses. 

How many students are there m Mrs. Jones' class? 



OO 
00 



OO 
61 



• OO 
.00 



,00 
-03 



Alice has 8 cents more than Julie. 

Alice and Julie have 40 cents between them. 



3J 



fa 



-3V 



How much does Julie have?_ 



Three y*ar<; from now. Bill will be twice as old as Bob. 
Two years from now, Ed will be 5 years old. 



•5lT 



3* 



How old is Ed now? 



Site A 



Site B 



Site C 



Number of Students (eH (p3 

KR2C Reliability . £/ . 55* 

Mean Reading Score JLO.O £0-0 

Correlation: Scale and Reading .30 
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32 4b 

13.1 IS-.3 



10 

/&J is. I 

.11 



(See peige A147 for statistics and comments.) 
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(W5) Word Problems, Sites A, B, and C. (Form B) 



Test Items 



Percent 
Correct 
C N 



B1 serial 
C M 



Form 8 



Don bought i bag of 20 new marbles. 
He now his 75 marbles. 

We want to know how many marbles Don had before he bought the new ones? 
Hark t nuofcer sentence that cannot be used to solve this problem. 



20>75«n 
75-20+n 
n +20-75 
t\-75-20 



SI 



A jar holds 1/2 as much as a pitcher. a 
If the jar holds 8 pints, then how much does the pitcher hold? b 

c 
d 



16 
12 
4 

2 



pints 
pints 
pints 
pints 



?7 

3V 



h9 

3f 



. 3© 



.C»/ 



.of 



The boy scouts reserved 4 rows with 7 seats in tach row. 
Only 18 scouts came to the game. 

How many seats In the scout section were not filled? 



a) 46 

b 28 

c 10 

d) 8 



to 

JUL 



Si 

37 



TPS— 
'3/ 



J111 took tickets at the movies. 

Adult tickets were SI .00 and children's tickets were 50t, 
*Q adjlt: art! 60 children bought tickets. 

How much money did they collect 7 



a) $100 
b $70 
c $60 
d) $50 



I? 

1/ 



76 

p7 ( 



.03 



57 

,3? 



Ellen bought 12 pepper plants at a sale price of 3 plants for 40t. 
They usually cost 25< each. 

How much did she pay for the j>1ants? 



b 

c) 
d 



$4.80 
$3.00 
$1.60 
$1.20 



7 



.2 iT 



n 



.ho 



A1 together Mary and Sally have 36 candies. 
Mary has 3 times as many as Sally has. 

how many candles does Sally have? , 
Site A only. 



a 6 

b) 9 

c) 12 

d) 27 

t) Can't tell 



3o 



>S2 



One day Terry found some marbles. 

The next day he found twice as many marbles. 

The third djiy he found one mo re. 

That gave him 16 altogether. 



How many did he find the first day? 
Site A only. 



f2 



3<7 





Site A 


Site B 


Site C 


Number of Students 


<f>2 (tip 




</3 77 


KR20 Reliability 


. G>7 . 7 2 


.13- 


./9 


Mean Reading Score 


2.0.0 yjb.o 




16.) 


Correlation: Scale and Reading 


.30 
1 


.lie 
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(W5) Word Problems 

(Combined student pages from all 
sites are shown on pages A144 and 
A146; no site was given all the 
i terns . ) 



Site 


Adjusted Means 


p-vilue 


CSMP 


Hon- CSMP 


OA 


3.5 


3.3 




OB 


1.4 


0.9 


.02 


At 


1.1 


1.1 





t 



No graph is presented because of 
different items in all three sites. 



fetns by Ability Levtl 



Site B 


1 


2 


3 


4 


All 


'cs*> 






/. 5" 


/• / 




Non-CSK> 




/.3 




/• 3 


l.W 


t-SUt. 




>t 




w 


.3 



Mttns by Ability Ltvtl 



Site C 


1 


2 


I 3 


4 


, All 


CS*> 




1-0 




11 




Hon -CSMP 


1-3 


1.3 


I.I 


to 


hi 


t-SUt. 


-.5 


l>0 


.* 


•7 





Comnents: 



-At all three sites Form A was considerably harder than Form B. 

-The "Venn Diagram" item (#6) which was administered at sites B and C was the last 
item on the last page. While the difficulty level of the item might have contri- 
buted to students' poor performance, the time factor cannot be ruled out. 
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(W6) Amount of Information 



Test Items 



Percent 
Correct 
C N 



B1 serial 
C N 



Form A 



_ l 

1. Mrs. Smith bought 3 cases of pjckles. 
Each case contains <6 jars. 

How many pickles did Mrs. Smith buy? 

2. My cow weighs 4 times as much as my goat. 
My goat weighs 3 times as much as my dog. 
My cow weighs 600 pounds. 

How much does my dog weigh? 

3. Three boys- spent an average of $10 each. 
How much did the 3 boys spend altogether. 

4. Al has twice as many pencils as Ed. 
Paul has 3 more pencils than Ed. 
Who has more pencils, Al or Paul? 



Form B 

1. There are 96 boys^i^the school. 

1 There a,re 89 girls 1n the school. 
* How many buses will be needed for the school picnic? 

2. A car goes 55 miles per hour. 

It 'goes 15 jriles for each gallon of gasoline; 
How long will 1t take the car to go 165 miles? 

3. Pat and Leslie have 30 books altogether. 
Pat has 8 more books than Leslie has. 
How many books does Pat have? 

4> A man needed 9 fence posts on each side of his square garden. 
The fence posts were 6 feet apart. 
How many fence posts did he use? 



erjc 



Number of Students 
KR20 Reliability 
Mean Reading Score 
Correlation: Scale and Reading 
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(W6) Amount of Information 



(Becadse of the unusual nature of this scale, and the scoring requi 
result, the usual summary statistics are not available at this tim 
data are being reanalyzed.) . 




Samples 



a) Ties cost $5 each. 

Bob bought 3 ties. 
^ How much did he spend on ties? 



□ Need to know more 



(vj Exactly the right amount of Information 



□ Too much information (cross out the extra Information) 



b) A box 1s 10 Inches long. 
It 1s 8 Inches wide. 
What 1s the volume of the box? 

gf Need to know more A/ouj ki^k +hc -box /'<f 

□ Exactly the right amount of Information 

□ Too much Information (cross out the extra Information) 



c) Tom bought 12 apples at 10< each. 
■ H o als q bou gh t <\ candy b a rs . 
How much did he spend on apples? 

□ Need to know more_ 

□ Exactly the right amount of Information 

SfToo much Information (cross out the extra information) 




\ 
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APPENDIX B 
Interviews 
CSMP/Non-CSMP Sixth Grade Students 

Rationale Bl- 4 

and description of the 
study and sample 

MANS 

Scales and student interviews B5-24 

(Al) Algebraic Symbols B6- 7 

(A2) Solving Equations. . . . f . . . .B8- 9 

(A3) Summation Operator ""felO-12 

, (A4) Multiplying Summations B12-13 

(A5) Functions B14-15 

(P4) Dependent Outcomes B16-17 

(P5) Conditional Probability^ . . . \ Bl 8-1 9 

(L4) Identification / B20-21 

(L9-10) Venn Diagrams ' B22-24 

Non-MANS 

Tasks and Student Interview B25-46 

Geometry B26-41 

Pattern Recognition/Generation B43-46 

Summary B47 



Interview Study 



ERLC 



Rationale > \> 

In order to observe students' difficulties both in understanding the task 
demands of several of the new scales and in solving items in those scales, CSM£ 
and Non-CSMP students were interviewed at the time the scales were piloted. 

A brief discussion of the procedures used in^the interview study and a 
brief summary of theVesul ts^ of the study are presented in CSMP Evaluation 
Report Ladue Sixth Grade, 1981 „ (Report #4) pages 43-64. This appendix will present 
an amplification of the results described in those pages. 

In this section., a sample of the student page for each interview task will* 
be reproduced and the purpose of the scale will be discussed. Following that 
the various levels of students 1 success with each scale will be presented and 
samples of students' verbatim records (enclosed in boxes to aid readability) 
will be included to show how students at each'of the levels solved the items* 
Following that there will be a brief summary which will relate students' 
interview performance to the data frcm the administration of the scales under 
the testing conditions. A description of the sample is also included. 

In all, eleVen tasks were presented to the 30 students; nine of the tasks 
corresponded to the MANS scales in the test booklets and two were novel tasks 
which were being administered on a. more experimental basis. Sampling of 
scales was done because of time limitations and an average of 4 to 5 scales 
were administered to each student. ^ 

s 

Bl 



In all, thi.rty students were interviewed. 



Number of Students Interviewed 
where x = CSMP students and y - NonrCSMP students 



KMC 



FEMALE 



TOTAL 



Above 

Avenge 

Ability 



Plow 

Avenge 

Ability 



Tottl 




All students were interviewed individually by one of two interviewers- 
Interviews were conducted in empty classrooms or offices anc^ took place while 
the rest 'of the class was doing the MANS tests. 

The eleven tasks and the pages in Appendix A where summary data on the scales 
- can be found are as follows: . - 



L PrelA ^bra : (Al ) Algebraic Symbols - Appendix A, pages A6-7; (A2) Solving 
Equations - Appendix A, pages A8-9; (A3) Summation Operator - Appendix A, pages 
A10-11; (A4) Multiplying Summations - Appendix A, pages A12-13; (A5) Functi 
Appendix A, pages Al 4-1 5 . 



ons - 



— L °3 ic : (L4) Identification - Appendix A, pages A54-55 and (L9-L10) Venn Diagrams 
Appendix A, pages A60-63. (Note: In' this report the logic tasks will follow the 
probability tasks.) 



B2 
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h Probability : (P4) Dependent Outcomes - Appendix A, 1 pages AllO-lll and (P5) 

Conditional' Probability - Appendix A, pages Al 12-113. (We: In this report a dis 
cussion of the probability tasks will preceed a discussioW of the logic tasks.) *■ 

- 4 

\v % 

4. Geometry : Figure Comparisons - Ladue Report, pages '52^63. 

■ I ■ 

5. Patterns : Pattern Recognition/Generation - Ladue Report^ page 64, 

Students' performance for each of these categories will uk discussed in 

turn. 



The data will follow the format shown below. 

- Scale Name 

Rationale of the Scale . t 
Number of Students Interviewed 



r 



Description of students' levels of performance 

■ f (Number of students (CSMP/Non-CSMP ) at each level.) 



Stude'nt 

Verl^ptim 

Transcript 



Mans items 
student solved. 



Discussion 
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Results 

Overall, students, both CSMP and Non-CSMP, displayed^several different, 

j 

levels of success with the tasks: some students showed that they understood 
the task, and were able to correctly solve it; some students had understood 
what .was required for solving the task but made errors in computation or 
strategy; other students appeared not to a) understand what was required of 
them and b) as a result made errors both in computation and in strategy. 



For all the tasks only a few (4-10) students were interviewed and the . 

CSMP/Non-CSMP balance was rarely 50/50 so conclusions about CSMP/Non-CSMP 

performance cannot be linequi vocal . As far as understanding the tasks and completing 
. the tasks, both groups performed about the samey across all tasks; however CSMP 

students(general ly tended to fall into the higher ability levels more frequently 
- than the lower ability levels whereas Non-CSMP students were found in the lower 

abi lity* levels more frequently than CSMP students. 



\ 



4 



ERIC 



B4 



MANS SCALE STUDENT INTERVIEWS 



1. Prg-Alqebra 

•& 

i 4 M ) Algebraic Symbols 

Students were given written examples of the use of algebraic terminology 
(a letter represented a number; for example: 2a means 2 times a. If a = 6, 2a = 

2x6= 12). The purpose of the scale was to 'determine how well students could' 
solve equations by substituting the numbers for letters when one or two variables 
were present. 

Sample: 

In these problems, Wttert, sund for m*e>trt. 



A/S«9plts: 2* Mtns 2 tines t. If t • 6, 2* • 2x6 * 12. y 
' 3bc Keens 3 tines b Maes c. If b • 2 end c • 5, 3bc • 3x2x5 • 30. 

' % 

Problems 

If c • 4 and d • 3. then 5cd • , 



If c • 2, f • 2 end g • 3, then 4efg 
If y • then Hy • 



N =-6: 2 CSMP, 4 Non-CSMP 

There were three levels of ability shown: 

, * Level if Students appeared to understand the samples 

and made no errors in computation. 

(1 CSMP, 1 Non-CSMP) 



Example: 



CSMP 


- 5 2 


means 5 x 5 - 25 




6 2 


would be 12--no, no, 36 , 




4 2 


would be 16 


If d 


= 8, 


2 

then d would be 64. 



4b" 



8, then d • 



and the Non-CSMP student's solution was equally straightforward. 
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Level 2: Students appeared to understand the samples 
and initially made no errors in computation 
but subsequently began to make errors. 
(1 CSMP student) 



Example: 



2 

6 equals 6x6 equals 36 




2 * 
4 equals 4x4 equals 16 




If d 5 8, then d equals 8x8 = 


64 


3 2 

if a » 2 and b * 3, then a b * 


(long pause) 


2x2x2x3x3* (long pause) 


144 


If c ■ 1 , then c 5 * 1 


5 x 5 » 25 ^ 


If d » 5 then 2d 2 » 5 x 5 x 5 



6 2 - 



If d • 8, then d z ■ 



If 4.« 2 and b » 3, then i 3 b 2 » 

If c • 1 , then c 5 ■ m 

If d • 5, then *2d 2 « / 



1 i 

i Level 3: Students made errors which indicated they 
dia not begin to understand the^perations 
requi red. 

(3 Non-CSMP students) 



T 



Example : 



2 

5 means 5x5 (reads sample) 

* 

6 x 2 woul^ be 12 and 4 x 2 would be 8 
If d * 8, then d x 2 would be 16 

If a ■ 2 and 1) ■ 3, taen a 3 is 2, so 2 x 3 3 6 
and b ■ 3. 3x2*6, then, \t would be 12. 
If c * 1 , theo 0x5*5, 



6 2 < 
4 2 - 



If d • 8. then d z • 



If 2 and b ■ 3, then a 3 b 2 ■ 
If c • 1, then c 5 • 



Discussion . * 

— « : 

The interviews show that when students incorrectly solved the one variable 
equations, it was because they multiplied by "2"*instead of squaring. In the 
two variable, equations students lost track of how many times to multiply or 
incorrectly combined operations. Thus students who 'incorrectly, sol ved "If 
d = 5, then 2d 2 = ?" usually omitted a step and said "25" or'"10". 
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-(A2) Solving Equations ; . . 

. This scale, a variant of AT, required students to solve simple equations. 
Unknowns were represented by letters and instead of substi tuting a given value, 
students had to solve for the value. 

♦ 

Samples : 



d ♦ 13 • 14, so d 



e • 4 ■ 5. so e 
6 x f ■ 12, so f 



N = 8: 3 CSMP, 5 Non-CSMP m . 

There were three levels: 

Level 1: Students correctly solved all items, 
(2 CSMP Non-CSMP) * - 

Example^ 



d + 13 * 14 so d must be 1 
e - 4 3 5 so e must be 9 
6 x f 3 12 so. f must be 2 'cause 6 x 2 * l2 
g ♦ 4 » 8, so g » 32 because 32 * 4 « 8 
% 7 x h + 1 - 15 so h must be 2 because 7 x 2 ■ 14 + 1 

3 x ; - 6 » 15 so y 3 3 x J because 3 x 7 is 21 minus 6 is 15 



d + 13 • 14, sod « 
t - 4 • 5, so e ■ 
6 x f ■ 12', so f 

g J- 4 • 8, SO 9 

(7 x h) ♦ 1 • 15, so h 
(3 x i) - 6 • 15, so I 



L6ve1 2: Students correctly solved almost all items 
i 

b.ut made simple computation errors. 



> 



(1 Non-CSMP) 
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Example: 







d ♦ 13 • 14, 


so 


d » 


d + 


13 ■ 14, so d ■ 1? 








t - 


4 • 5, so e * 9? 


e - 4 • 5, 


so 


e - 


6 x 


f = 12, so f = 2 








d * 


4 * 8, so d, 2 


6 x f • 12, 


so 


f » 






9*4-8, 


so 


9 ■ 



Level 3: Students correctly solved the first few items but 
made errors which indicated tljey did not under- 
stand the algebra concepts involved. 
(1 CSMP, 3 Non-CSMP)* 



Example 

r 



(Solved Items 1-5 correctly) 
Then 

(3 x 1) (long pause) (3 x i) - 6 - 15, so i 1s (long pause) 21? 

I don't... 

and 

2ks , 5 + 7 » 1 , no I mean (long pause). 



(j x j) + 1 « 26, so j 
k + 2 + k + 1 » 11, so k 



Discussion 

The first three- problems called for comparatively simple computations (addition, 
suBtraction, multiplication) but solution of the item with a division sign 
elicited an incorrect solution by division strategy. The more complex items, 
involving two operations, caused student^ to lose track of their operations, and 
unknowns. The difficulty which* students had^in the interviews is paralled by the 
difficulty others had in the testing situation. 
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(A3) Summation Operator 

Students were introduced to 'a novel summation sign ( j3Cj called "an anvil" 
or "a funny thing^^fcnd were given two examples which showed> "how the 'funny thing' 
worked" and were also given three practice sappples. They were then expected to 
solve other items using the same summation operations. 
N = 9: 5 CSMP, 4 Non-CSMP 

Level 1: Students experienced difficulty/confusion with the first 
few items which was resolved when the interviewer used 
socratic type questioning. 
(3 CSMP, 3 Non-CSMP) 



Example; 



Well, it has^a box up here and two circles stuff. (Yeah, right. 
What are you going to caJl that?) That. (Okay, but what are you going 
to call that strange symool?) 2- to 6, you mean? (Yeah, but you're going to 
have to say something. What are you going to call it? Got a name for it?) 
The shorthand. (Okay, 2 shorthand 6 is a short way of writing 2*3*4* 
5 * 6... how about this one?) From 6 * 7 + 3 * 9, the last— the first and 
the last would be 6 to 9; 2 shorthand 7 » would be, uny4t would be 2 to 3. 



Ml + 



= 



Level 2: Students experienced no di ffi cul ty .wi th tfhe'first few items but 
then had difficulty with items which was still not resolved 
via socratic techniques, i.e., students discarded the operations 
m shown in the samples and used a perseverati ve addition/subtraction 
strategy. 
(2 CSMP) 



ERJC 



BIO 

J 7 



Example: 

(Does the samples correctly, and the first Item, skips the second, and 
then solves the third as follows)' 

I'm trying to figure, to figure out how to put it into one of these things. 
The answer is 21 but I'm trying to figure out how to put it into (21?) 
This number here stands for 1 + 2 + 3 + 6 and this is 4 + 5 + 6 which 1s 15 
and 15 + 6 is 21. 



Level 3: Student appears not to understand 'the samples and items. 
(1 Non-CSMP) 



Example: 



2 £}C^ 6 * s a short way of writing 2 + 3+ 4+ 5 + 6 so 5+6 + 7+ 8 can I 

be,w^tten 5+8: (No, can be written 5 ^)Q 8). So 3 + (silence) can be 
written as, I guess- 3 + 8, 3 + '(silence) 3 + (silence) 1. Can the middle one 

be anything? (No, take a look at this one. Now, 2 + 3 + 4 + 5 + 6 and 

5+6 + 7 + 8 has got to be 5 0(^ 8 so 3 ^^ 5 has got to be what/) 

Let's see. (Silence) 3 + 5, I mean 3. I kjiow the first one'sXs and the last 
one's 5 but the middle one is... there has to be a pattern... 



+ 



+ 



Discussion 

- While some students "cracked the code" for using the operator in almost 
all cases, other students were confused about the symbol. For some students, 
even practice and coaching did not erase their confusion. Even when students 
were not confused about the general use of the operator there wePe occasions 

when they were confused about whether to subtract the 4 from 
the 5, the 5 from the 4 or insert a zero). T he test data show that thereiwas a 
similar confusion. When the task was "linear" i.e., adding from 1 to 6 (l jOQj 3 
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+ 4 |pCj 6 = ) students were usually successful but "non-linear" operations 
(where there was no straightforward continuation of an already established pattern 
to "copy") gave students difficulty (as^the results of 7 + 6 QCj a = showed). 

(A4) Multiplying Summations 

This scale extends the use of the novel operator which was introduced to 
students in th'e previous scale. 4% \ 

\ 

N = 5: 1 CSMP; 4 Non-CSMP J * 

Level 1: Students began correctly then became confused. ' 
(1 CSMP, 1 Non-CSMP) 



Example: 



4 22 7 equa1s 4 22 7 p1us 4 22 7 and then 2 22 7 p 1us 2 *22 8 

equals 2 DC 7 plus 1 with a two up there and 3^£J 6 + 4 22 7 ec ^ ua1s 
322 7 3 22 7 p1us ( si1ence ) P 1us 1 P 1us don,t know >- 



5S2 = 22 + 



Level 2: Students began incorrectly, but then through socratic 

questioning correctly solved the items. N 
(1 CSMP, 1 Non-CSMP) 



Example : 



2 equals (read the samples) Okay. Got 1t. 4 ^g 7 - 4 7 

+ 4 ^)Q 7 (and continued.) 
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Level 3: Students Seemed confused and were unable to solve any items' 
(2 Norr-CSMP) 



Example: 



2^£5ths m1...equa...2[2^5ths «<»uals 2^5ths plus 2£[£5ths plus 

(Alright, what do you make of that now? The way you read it, 
it sounded like nonsense.) It does, ha/ ha. (O.X. Is there something you 
didn't read?) Ah, the" three over. (O.K. the three over) ah, urn, ha (So if 
you'd of said 3 over 2^5ths, equals 2^5ths plus 22C5ths 2 5ths 
P lus 2^Q5thsJ ah, (Alright, does that make sense to you then?) Yeah. 
(Alright. ..O.K. so 3^8 plus 3^3 would be 2^over 3^8 O.K.?) 
Yeah 2 over would be 4^7 47. (Alright, O.K.). and 2^7 plus 

28 would be a, ha, U m aw, 2 over 27 plus l\ no plus 8 (Alright) 3^^6 
Plus 4^7 um, 2 over 3, 3 7 P lus » gosh I needa use the seven. 
CAlnght go ahead and put that down.) Oh, (O.K. But you're not real sure.) 
Yeah. v 



-552 + m+m 
□ 



Di scussi on 



Again, students were confused about the relations between the operator 
and the numbers. The first item, which most students were able to solve, involved' 
the same "linear" solution strategy which students were able to use successfully - 
in solving many items in (A3). However, when the items became more complex and 
called for more complex solution strategies the- interviewees had difficulty keeping 
track of the operations." 
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(A5) Functions * , , 

An operator symbol is shown to students and they are given samples of how the 

symbol' changes sets of configurations. Students must" then apply the same changes 

» 

to other configurations. Producing those changes requires the coordination of 
several within-configuration variables. 



Sample: 



Things Cin bt changed with 



1- ^ chwges T to We sho* this 'change by saying: 

2 "^changes A to > ^ "jk Say s ^ ( A) - > 



3 ; 



All students (3 CSMP and 2 Non-CSMP) correctly solved these items. Both * 
groups of students expressed confusion about what was expected of them for one 
or more items but they did solve those items" correctly. Both groups of students 
turned the paper sideways to check for the correctness of figure orientation. 



The 1 and the 2 t+ up here on top of each other because up here it says 
* change the 2 x's" and circle on the bottom to a circle on the side with 
2 x's kind of on top of each other. And that was what that was and so I just 
changed It ground, (long pause) Because, up here it says: Right there an x 
with 2 circles and to do it changes*"it to that. So, I moved 1t around--and 
then M urn (long pause) because up here it says and I just switched it around 
to what the directions said, (long pause) Because if you--okay, you move the 
backwards w t" right there, the other "L" will go there and tljen the x would go 
on the bottom right there. 



4-+ 



do 



T 



and then 



do 



\j and th«n 
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1 , Well the "I" makes this turn so the line facing up would turn to the side 

9 

**so tt woOltf gi) In east-west direction. And the "3'' would turn the M M" to 
the side so It would be like lying down kind of and the " could change the 
2 o's and the plus on its side— and the "N" which we'^re supposed to find out 
what happened. That would be like that (does ^it correctly ). 



The xx's and the ooo's. There's 3 o's and 2 x's. I just make the x's have 
3 and the o's have 2. The backward " ^ \ An'd then the "T' would turn z and 
the 1 to 2 Is and 1 z. And then this one I had trouble on— I didn't know this 
one that much. Okay, the " '* would turn the 3 Vs— the upside down Vs— and 
3 ♦ s, I think 1t changes It to 2 vs and 2 ♦ s. I'm not sure If that's right or 
not. And this— the last one. Um (long pause) Okay. This one, would be 
(long pause) 3 os and 1 y. 



M ^ M means that you just change the figure sideways so you do that (does It 
correctly) -and then the same with all these. You turn the sideways and you turn 
the two circles sideways *nd the plus sign, and in this one the— Its like an 
I turned on Its side so I put It back like that. 



X (•")• 

X(r.:)- 
X( )• 



its)- 



o 

YY7 



Discussion 

Most students relied on visual cues, i.e.; turning their papers sideways 
or re-copying the configuration and drawing a new configuration and rotating each 
variable within the configuration. Once students understood that only a rotation 
was required and ho addition ; subtraction , etc., they were able to compl ete~th.e 
scale. When they produced errors it was due to confusion "about how much of the 
configuration should be changed--all or only one portion, as well as confusion 
over the sequence in which the operators were used. 
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(P4) Dependent Outcomes . 



f 



Students were given spinners (A and B) and a set of conditions (winning 
-means- a« combined score of at least 15 on one set of items; winning means getting 
a larger result with spinner A for apother set of items). Students had to 
combine all the possibilities exhaustively in order to achieve the correct answer. 



N = 7: 4 CSMP; 3 Non-CSMP 



Samples: 



Rules 
Spin 2 spinners. 

Add together the numbers the 2 spinners point to. 
You win If they kdd to IS or nore . 
Play the gene TOO tines. 



If you pi eyed with these spinners: 



How neny times do -you think 
you would win out of 100? 



II. Rules 

> Spin 2 spinners. 

You win If Spinner K points to a larger nuober than Spinner* 
Play the game 100 tines. < 



If you played with these 2 spinners: 



How niny tines do you /think 
you would win out of 400? 



.4 




There were three ^leve-ls-of solution for this scale; 
Level 1: Students used a combining strategy 
and used it exhaustively. ^ 

(2 CSMP) 
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lou do how many, times If you plussed 4)1 of these togetheV-^ocid^ou get 
over l^or more? And you get 100 changes". I put 75 because the only— would 
you— couldn't do It Would be 7 x (sic) 7 and there's four ways of doing It, 
1, 2 and 3 and the only way would-be 7 x (sic) 7. That Is 14 not 15— so 
you minus 1/4 that and that would be 75 out of 100. 



If fou p\*r*4 4ui Cfcoto iHrwtri: 



0© 



How wav dm 4o you eJiffik 
you would win out of 100? 



Level 2: Students had a combining strategy but they 
used in non-exhausti vely. 
CI CSMP, 1 Non-CSMP) < • 



You would win, you woald win— let's see, SOX of the time because 8, because 
because (pause) 75X of the time on a scale of 1/4 (How come?) 3ecaus« there's 
two sevens you'd win 50X of the time 'cause If I spun It I'd get 7 r and 1f I 
spun It I'jA get*8 and there's only 4 figures, 4 numbers so^that would be 
SOX of the time. 



If you »Uyoi rtu uw$« %9im*n: 



*y timm m y*v U\Uk 
*14 win out of 100? 




Level 3: Students • used no strategy, were confused and 



relied on guessing, ' 



(1 CSMP, 2 Non-CSMP) 




I really don't know why but I think It's 25. 



If you »l«r* It* ttwto tolfwon: 



Mom mat t1o*s * y«u tfilnfc 
you woula •<« «ut «f 100? 



•©■© 



Discussion 

When students were aware of a strategy, i.e., combining both numbers on both 
spinners a*vd they used the strategy exhausti vely t they could solve the items. > 
Errors were^made when they failed to use the cor|ect strategy (Le. guessed) or 
when they were not exhaustive in their v use of allj four numbers, 

■ ";• • • 1 




. (P5) Conditional Probability 

Using spinners shown students were required to predict the frequency with which 
given numbers would appear. To complete thd task successfully student^ had to 

% A 

know that the results, of the first spin (getting A or B) -then affected all sub- 

* k 

sequent result^ Students also had io calculate exhaustively the possible outcomes. 



Samples:' 



S 



Rules to pliy Same 1. 



1. first spin this spinner! 



2. Thtn: If you 9ct A. spin Spinner A OR If you get B. spin Spinner B 



Pretend you pliyed the game 100 times 

How uny tlaes do you think you would get 4? 
How uny tines do you think you would git 5? 
How »ny tines do you think you would get' 6? 



Rules to pliy Caww 1 



1. First spin this spinner I g 





\ 



2. If you gtt A, 
spin Spinner A 



OR 



If you get B, 
spin* Spinner B 




OR 



If you. get C, 
Ipln Spinner C 




N = 4:\ 2 CSMP; 2_Non-CSMP 

^The^e.were two levels. of stu^ft sol uti on for t2his scale: 
Leve\ 1: Students successful ly used' a comprehensive; slrategy. 



\hi 



\ 



(2 CSMP) 
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Well, since there ire 3 chances, you have tore chances to get A-than 8 but 
there aren't any 6s on B so I figured that the 3 6s, there are^only 3 6s 
out of these 8 quarter shapes so I figured It would be 37; 



/ 



1* Flrlt spin this spinner 



2. If you Qtt A, 
spin Spinner A 

A * 



Oft- 





if you get B, 
spin Spinner B 



Pretend you played the game 100 tires 

How «any tlaes do you think you would get 6? . 



Oft 



if you get C, 
Spin Spinner C 



m . ® 
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Level 2: Students were not successful and 
s (2 Non-CSMP) 



used a confused strategy, 



1 don't know how you'd figure the percents.on this. Urn. If 1t were pointing 
to 4 and If it were pointing to 3 It woulp^work. " 6 and 7, It wouldn't so 
that's 2/3. It wouldn't work. If 1t were 5 only, 3 would work again so 
that's 3 (long pause) 30?. I don't know what the percent s would be. 



1. Flrtt spin this spinner I A 8 J 



2. If you get A, 
~* spin Spinner A 



® 



OR 



1f you get 6, ' 
spin Sp1nnerf6# 



Pretend you played the oage 100 times 

How »any tines do you thlnkyou would get 6? 



Discussion 



Oft 



1f you get C, 
spin Spinner C 




As with (P4),-.some students understood the task, had the correct strategy, 
and used it exhaustively, while other students did not understand how to calculate 
the probabilities, were confused by the multiple combinations, and guesse^. 



I- 



(L4) Identification 



This scale required students to use negative information (Tom doesn 1 t 

4 

play hockey), to eliminate players by using the clues correctly and to coordi- 
nate two sets of clues (t.e., indoor/outdoor and sport or days of the week and 
sport) in order to assign players to activities. 



N = 8: 5 CSMP; 3 Non-CSMP 



'There were three levels of solution fort^hfs, scale ^/ 
Level 1: Students did the scale correctly ( and did it by * 

"reading off" the text and making correct assignments • 
" without recourse to paper and pencil record keeping.) 

(2 CSMP, 1 Non-CSMP) 
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Ed doesn't pity outdoor (pause) doesn't pi *y soccer. He plays hockey. Ed 
plays Indoor hockey. Tom, lei's see, Bill plays Indoors. Bill plays 
indoor soccer. Tom plays outdoor soccer so (>ete must pity outdoor hockey. 



Level 2: 



These are the 4 boys: 8111 Tom Ed Pete 

Thesewre the 4 leagues: Indoor soccer outdoor soccer Indoor hockey outdoor hockey 



These are the facts: 



Each boy plays In a different league. 

8111 plays Indoors- 

Tom doesn't play hockey. 

Ed' docsn't pUy outdoors £nd he doesn't play soccer. 



Wh#t league d'oes each boy play 1n? (Circle your aimers) 



8111: 
Tom: 
Ed: 
Pete: 



Indoor soccer 

Indoor soccer 

Indoor soccer 

Indoor soccer 



outdoor soccer 
outdoor soccer 
outdoor soccer 



Indoor hockey • outdoor hockey 



Indoor hockey 
Indoor hockey. 



outdoor hockey 
outdoor hockey 



outdoor soccer b Indoor hockey 4 outdoor hockey 

* ? 



Students, incorrectly assigned one or more players 

t 

( and also did it by M reading off); the incorrect 

assignments were a) non-specific for one or two players (<i.e.,* 

Pete played hockey) or b) a double assignment for one or more 

B20 1 w. ' * 

«*■ w 



.players (I.e., Tom plays indoor soccer—Pete plays indoor v , 
soccer) 

(3 CS.MP, UNon-CSMP) 



Bill doesn't play, till plays Indoors so he can't pity outdoor soccer and 
• he can't play outdoor hockey, urn. Tom doesn't play hockey. Bill plays, he 
can either play Indoor soccer or indoor hockey. Tom doesn't play hockey. 
Ed doesn't play outdoors and he doesn't play'soccer. Okay, so Tom plays, 
um. -hockey, so Bill has to play Indoor soccer and Tom does^t playWkey. 
Too tes-well, Ed plays Indoor soccer. Okay. Tom plays outdoor soccer and 
Pete plays outdoor socVl mean hockey. > 



Level 3; 



Student made incorrect assignments and seemed to 

guess (i.e., "Well, it doesn't say anything about 

< 

Pete, so he must play them all.") This student 
used paper and pencil to keep records. 
(1 Iton-CSMP) * * * 



Directions. Okay. Bill would play(lohg pause; writes down sports; long' 
pause) and um. T6m would play (longrfause) writes down more sports '(long 
pause) um— 

(Reads) It sa^s Bill. Oh, 1 got It backwards. Bill plays Indoors . It'd be 
tfcie other way round. 6111 plays outdoor soccer and outdoor hockey. Bill does. 
(Reads) Bill plays Indoor^. That Is right. Bill plays Indoor soccer. 
Indoor hockey. Yea. thafd be right ff on this scale B1 1 1 plays indoors— 
and Tom—Tom doesn't play hockey— Indoor and outdoor— soccer and Ed doesn't 
play outdoors and doesn't pfay soccer so he would— play Indoor hockex— um— 
and Pete— 1t doesn't say anything about Pete so he'd play all of them I guess. 



Discussi on 

Student errors resulted, from an inability to assign one and only one player 
to a sport. f The confusion was compounded by the fact that few of the students 
interviewed attempted any systematic record keeping but instead "read off'Hhe 
questions and then began "reading off" answers. 
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(L9-L10) Ve nn Diagrams 

Students were required to solve a two-way classification (L9) or a three- 

% V. * 

'way,, cl assifi cation (L10) problem where a simple addition strategy would yield 
the wrong answer but assignment of data via Venn Diagrams would be helpful for 
a correct solution. * 



Samples: 



In Hrs\ JoneS 1 class. « 

11 students wear ttnnls shoes. 
17 students weir glasses. 
8 students wear tennis shoes and glasses. 
2 students don't wear ttnnls shoes or glasses. 



J 



Write your answers In the blanks. 

How aany students are there In Hrs. Jones' class' 

mi* 

How aany students wear either ttnnls shoes or glasses but not both? 
How «tny students wear glasses but not tennis shoes' 




In Mr. Smith's class: 

J8jitudents play baseball ♦> 
13 students play basketball. 



21 students play football. 
No students play nil three sports. 
No students play both baseball and basketball. 
.7 students play both fooh>a11 and baseball. 
17 students play football but not basketball 

How many students play baseball only? , 

How nany students -play football only?'. 

r 

How nany students play -basketball only? 
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There were four levels of strategies: 

^ 

Level 1: Students correctly solved the scale. In 'this 

catego$ were students who appeared to be using a 

good strategy and^ correctly solved the items* (2 CSMP) • 

i' 

and also a student -who correctly solved the Refits but 

* a! 

who appeared to be confused while solving the scale. - 
(1 CSMP) 



22 students? (Tell me how you figured 1t out.) If 11 students wear tennis 
shoes and 17'wear glasses and 8 students are gonna be— that's 28 there 
who are wearing tennis shoes and glasses or glasses and 8 of those are 
wearing both that would be 20 who were just wearing tennis shoes or glasses— 
28 that's gonna be 30— though— I just— okay 28 students wear tennis shoes or 
glasses 8 wear both so at least 28-20 wear either tennis shoes or glasses. 
8 wear both tennis shoes and glasses and 2 students don't wear tennis shoes 
or glasses. * That's 30-20 wear either tennis shoes or glasses but not both, 
hm~but not tennis shoes— oh 9-9- (How?) I took 8 out of 17 because 8 would 
be wearing tennis shoes and glasses and 9 would be wearing 9. 



See items 
on p. B22 



Level 2: A student who tried an assignment strategy but who 
was confused and got the wrong answer. 
(1 CSMP) 



Ura-2-tenn1s shoes (long puase) Okay, this would be 3. Could I use a pencil? 
(writes down) .3. 8/l7. 11 - (Tell me what you're doing.) Okay, I'm 
mmuslng 8 from 17 and 11 because 1t says the. 8 students wear tennis shoes 
and glasses so you can mark 8 from here and 8 from here 'cause there's 
going to be 8 from the tennis shoes and 8 from the glasses because you're 
gonna have a guy in each cl . In each (pause) a student that's wearing tennis 
shoes and glasses. So just take 8 from each and that'll leave you 3 with 
tennis shoes not glasses and 17 or 11 with just glasses and 2 with tennis 
shoes. So you'll have 6, 16 students 1n Mrs. Jones' class. 



See items 
on p. B22 
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Level 3: Stents who added all the students. 



(2: CSMP) 

I 



4- 



M* 2 Is 30*. 28 antf 2 1s ft. There's 38 students 1n Mrs. Jones-. I 
idded these together. 



See items 
on pv.B22 



Level 4: ptudents who appeared to be confused and tried no specific strategy, 
'or guessed. , ' 

(2 Non-CSMP) v ' 



17 and 8 wear tennis shoes.' ifcay, 7, 6, 15, 17, 38. How many students 

|ar either tennis shoes or glaises but not both? Walt. Tennis— how many 
students wear either tennis shoek or glasses, that makes sense,, but not both. 
How many students wear either tennis shoes^or glasses but not both? 2. 
Ttyat doesn't make any sense, tfjat question. How many students wear glasses * 
but not tennis shoes? Glasses. This one, doesn't make nay sense though. 
How many students wear either tennis shoes or glasses but not both? They 
can wear one or the other but not both? fhe reason I put down 2 1s because.— 
but not both-. I could put 2, 11, 17 down, because 2--. How many students 
wear.elther tennl* shoeT^r^ asses. Well, they can switch. Thafd be 2. 
Let thaf be 2-8. That'd be 2^3. That's not a very good question. (2, 8?) 
It'd be 2 or 8. 



See items 
on p. B22 



Discus sJon , 

Students' cortfusion over the correct solution strategy was widespread 
as the results of testing show. Students were unable to assign the given information 
correctly and did not make use'of Venn diagrams or other aids to organize the data. 
After the interview, one student (CSMP) was asked if Venn diagrams could be used 
to solve the problem. She said yes, drew the Venn diagrams > put in the numbers 
and then added all the numbers— just as she had originally solved the problem. 
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Geometry v , 

The geometry task, unlike the tasks reported previously, w&s administered 

only in the interview situation. In all, 30 students were interviewed. All 
» - «» 

interviews followed the same standard format (which will be described below). 

The task was a simple one. EachWudent was shown five pairs of figures 
and asked to tell/in what ways the figures were "the same.'" 



The purpose of the task was to see whether or not svxth grade students , 'some 
, \ 

of whom were CSMP students and some of whorfTwere not, would be able to note 
similarities between parts of figures (angle size, line orientation, etc.) 
even when the figures^as a whole might not be similar. 



By interviewing students and asking them to tell in what ways the figures 

t were similar, we hoped to be able to analyze the data and design a geometry scale 

which would a) be understood as a paper and pencil task, and b^ be of an 
appropriate difficulty level for sixth graders. 

In the pa,ges that follow, a preliminary data analysis will be discussed. 
The data analysis is conservative. That is, some students did mention ways in 
which the figures were similar— but they did so after persistent questioning/ 
structuring on the part of the interviewer . Since that questioning and structuring 
was not done consistently for all figures and for all students, and since it 
represents a considerable amount of "coaching 11 , the resulting data are not included 
here. Instead, students 1 /comparisons prior to substantive interviewer intervention 

c 

.J 1 

are reported. 



s 

I 
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Geometry 

Each student was shown five pairs of figures , one pair at a time in the 
■same order for all interviews. The five pairs of figures are shown below.' 



Pair 1 



I I I 
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Pair 2 
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Pair 4 



Pair 5 
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Representative verbatim records of students 1 responses for each.of the 
pairs are presented below. Following the transcripts, a summary of students' 
responses for each paifc^itl also be presented. The summary, will briefly discuss 

1) Nomenclature used by students 

2) Students 1 comparisons of ^figure sides / 

3) Students*' comparisons of figure angles 

4) Interesting other comments made by students*. 

^/ 

In all interviews, questioning of students followed the format shown on 
the facing page flowchart. 



J j./ 



B28 



As each pair was shown to the students, the following protocol was used: 




r 




Student gives an 
unambiguous correct 
response 



Student gives an 
ambiguous response 
which Is possibly 
correct > v 



Interviewer: In wh'at 
other ways are they the 
same? (Continues as 
lo%o as students give 
correct unambiguous 
responses.) 



Student gives an 
Incorrect way the two 
figures are similar or 
a way they're different 



C. Interviewer: SUpw 
me In what Way 



us 
ro 



Student gives an 
unclear answer. 



Interviewer: Right, 
but In what ways are 
they the same7 



Student still gives 
an ambiguous response 



Interviewer: 
(Goes back to A) 



£. 



Interviewer: I 
don't see what 
you mean. 



(Oependlnq on 
student's response 
Interviewer goes 
to B t C t £ and 
continues. ) 



(Depending on 
student !s reply 
goes to B"b> C 
and contlnueS.) 



Student gives no answer 
or Indicates the question 
was not understood. 






F. Interviewer: Veil,, 
they're both, outlined 
In red (and then goes 
to B). 








Student talks about 
transforming the 
shapes. 






6. Interviewer: Just 
talk about the way 
they're shown here. 







Interviewer: (When student seems to have exhausted all- possibilities) F. Alright, 
Let's look at the next pair of figures. (Then begins with A.) 
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Geometry 
PAIR 1 



N ■ 30;J6 CSMP; 14 Non-CSMP 



Samples of Students' Respon sps 

Student X, whose comments are typical of non-specific responses: 

Both have an area (traces), both have squares In them: * They're sort of square ~ well, this, 
one': e square and that one's sort of a square. " " 



^Student r, whose responses are typical of the specific but limited comments 
given by some students: * \ 



\- 



Ea'ch Have 4 sloes and 4 comers. An' even number of squares • (gives a complicated retrlc 
based on 1nterlorJsquares)4 4 4 ♦ by 16 24 24 's t ' 

Color-wise-red and black squares around the edgus and white square. 4 high. Divisible by 4 



3tuu*er,t I, whose, responses atypical of^the diffuse' comments given by 



students: 




4 sides - both of .them are 4 sides. ' They - urn - each two of the parallel lines are even 
(P.Irs of parallel. lines are even). (What do you mean by even?) Well , these two lines. . . > 
I mean the lines are even with each other. (How do you mean even?) Well,' the qm length. 
(Same length, okay.) ,nd the same breadth. (What other wayj) They're, both drawn centered 
In the graph. (Centered In the graph, how do you mean by that?) Centered", well .here's ' 
the graph. One's not - urn. graphed. They're each a group of blocks In the sue in one 
Plane. One's not here and one's down here. (In what other ways?) They each have four x ' 
right angles. (Okay.) They're - each, of them can be broken up Into smaller squares - 
at. the bottom - the - « -/If you make , cross In the middle with the four squares here. 
If you did the same here you'd get 4 rectangles. (Okay) 
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' " ' . Pair 1 

1) Nonfenclature * 

.<■ \- 4 

Sides V • ' 

t 

Seventeen students (505 of the CSMP students and 645 of the Non-CSMP students) mentioned 

*\ 

"sides"; "lines" were mentioned by 6S of the CSMP students and 295 of the Non-CSMP students., 

* * 

Angles ^ 

Three students (135 of the CSMP students and 75 of the Non-CSfiP students) mentioned 

"angles"; 195 *f the'.CSJJP students and 505 of the Non-CSMP students called them "comers" and ta 

75 of the Non-CSMP students called them "potnts", * v ^ 

Naming the Figures . % * 

Fifty-six percent of the CSMP students and 505 of the Non-CSfiP. students referred tot the 
shape of the figures. However, students showed confusion in naming the figures. Both groups of 
students said they were "sort of squares" or were "square sh-aped rectangles". When probed fcr 
what defines a square^ and/or a rectangle, students offered either no response or a confused 
mix of technical and non- technical terms. 



2) Students' Comparisons of Figure Sides 

Twenty- five pe,rcent of the CSMP and 865 of the Non-CSMP students mentioned a> similarity 
between one or more lines in the figures. For the CSMP students the comparisons were based 
' . on similarity between one or more lines in the figures; for the CSMP stuuents the comparisons' 

were based on similarity of line length, while for Non-CSMP students, the similarity was just as 
often the statement that the lines were alilce because they were straight, 

. 3) Students' Comparisons of Angle^imilarity 

Only one CSMP student and one Non-CSMP student mentioned angle similarity - the CSMP 
I student saying "They have right angles on the corners.*' and the Non-CSMP student saying 

"They have right angles." c * 

4) Other Student Comments 

* An equal number of students (255 CSMP and 2*9% Non-CSMP) referred to the figures as not 

being "perfect" or as being "distorted" or as being "sort of squares", 

• , **In all cases percentages, or counts of students (CSMP and 'Non-CSMP) are reported only when 

students mentioned an/aspect (nomenclature, angles, etc). Thus a statement "7X oTtlie Non-CSMP 
) * students called them points" means no CSMP student called them points. 
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Student .M' s comments^ are typical of the n^n-specific comments made: 



Like 1n a triangle shape. 3 points* I'n not sure. On the same Hne* 



Student N's comments are typical of comments made about the "distortions" 
in the figures: 



Both sort of trltn v gles. Both hive an tret. ^traces) , (Show ne what you wen by that) ' 
That's sort of a triangle shape and that's sort of a triangle. It's a llttl* off but... 



/ < 

Student O's comments .are typical" of the comparative* statements made: 

Both triangles and they each have 3 sides. Well, they're not perfectly shaped triangles. 
V They have different sides but they're — you know^sa/ne shape - u, t they're not — the s1da* art the 

saoe length - between the saife length. They're both different lengths. three of them. 
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«■ Pair 2 

1) Nomenclature 
Sides. 

Thirty eight percent of the C$MP, students and 57% of the Non-CSMP students referred to 
"sides"; 6S of the CSI^P* students called them "lines" as did 43S of the Non-CSMP students. 

Angles. 

Thirteen percent of the CSMP students an<l-none of the- Non-CSMP students called them 
"angles";* 31X of the CSMP students called them "corners" 'as did 502 of the Non-CSMP- 
students^ 13S of the CSMP and 21* of the Non-£SMP students called them "points". 

Shape. ^ 

Sixty-nine percent of the CSMP studervts and 645 of the Non-CSMP studentTmentioned 
that both were triangles. 

r , 

2) Students 1 Comparisons of Figure Sides 
-- Forty-four percent of the CSMP students and 50X of the Non-CSMP students compared one 
or more of the sides of the figures. CSMP student^ made comparisons based on the 
similarity of .base lengths or V the's*ant of one of the sides; Non-CSMP comparisons mentioned 
that the lines were straight. 

3) Students* Comparisons of Figure Angles 

Only one student, Non-CSMP, mentioned angle similarity and. that reference was "no 
right angles". 

• * 
'4)' Other Student Comments • 

Two CSMP students mentfoned the area of the triangles, i.e., "both have- an area" and 
• trying to see 1f the area is the same", while two other CSMP students said the figures-/ 
were "sort of triangles". * > . 

i , ' 833 (j 




t 



Student E whose responses were typical of the specific but limited comments 
of some students: 

* i 

i » 

They have 4 comers and 4 sides. They're both have parallel line*. This also - well ... 

Student F whose responses show students 1 mix of technical and non-technical 
terms as well as the type, of si*de/side comparisons ; mader 



Both have four corners and four points, same colors around tha>s1des 

This is p«rallogram (shows) a pushed over square. V 

And I think they have the same area-they have the same area (demonstrates by pointing 

to squares across and down) and each side 1s, I think, the same (points to each- and traces) 

t 

Student G whose responses show more f comparisons , but alSo the non-specificity 

of those comparisons: - , 

* 

© i 

Both got 4 sides. 8oth^got 4 comers. Each of them - each of the parallel lines in each of ther 
are the same length. (In other words you wan the opposite sides). These two are the same 
length. These two. (Any other ways) * Wei 1 ... I was going to say you might classify them as 
squares. (In what way?) That they have. Oh no you couldn't. (What were'you thinking qf?) 
Well, I was thinking a square has 4 equal sides and urn 1 , angles. Angles (In what way does this 
qualify). This, well no. I was wrong because these - they don't have, there's just pairs' of 
angles. This has the same angle as this. .The corners, the opposite corners are the sa^e angles. 
(How 'bout the sides?) The sides - (You said before the opposite side? were equal) Were equal 
- well all sides are equal - (Both of them?) Yes. (Okay ghat's another thing the same then) 
I guess £o. * * 
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/"'-*. " ! • * ' Pair 3 

* * 

t 1) Nomenclature • 
Sides * •" • ', 

Thirty A one percent of the CSMP and 79% of the Non-CSMP students referred to "sides"; «ne 
CSttP student called them "lines". 

Angles t , f ' 

Onl/ane student, a CSMP student, referred to • "angles" ; 315 of the CSMP students called, 
them "comers' 1 as did 575 of the Non-CSMP students; 255 of the CSMP students called them 
"points" and so did 135 of the Non-CSriP students ; .one Non-CSMP student. called them "tips". 

» ' /. 

Shape . ... 

Forty-four percent of the CSMP students made some reference to shape but those references 

^ ranged from "this is a parallelogram" 'to "both boxes, kinda square up on the bottom". In 

contrast, 865 of the Non-CSMP- students referred to shape and most frequently referred ■ 

'to the figures as "squares'* or "squarish". 

t 

I) Students 1 Comparisons of Figure Sides 

Fifty-six percent of the CSMP ^udents mentioned side/side similarities - either in , 
terms of side length 'or in terms of sides being parallel but only one student mentioned both; 
-715 of the Non-CSMP students mentioned side similarity, the most frequent 'reference was that 
the sides^were straig& but one student also mentioned that ths lines parallel and were the 

same length. * 1 

i * M 

Students' Comparisons of Figure Angles ' 

Only one student , Non-CSMP , made an, angle/angle comparison, saying *The comers, the 
opposite corners are the same angles". 

4) Other Student Comments k , ' 

• Both CSMP students 'and Non-CSMP students showed confusion over what to call the shapes 
("both boxes") and also discussed straightening one of the figures ("If you'd slant this a , 
little, you'd. get that shape. This way you'd" get whatever that's called") to make it more 
like a prototypical figure - a square. 
O • B35 i g . 
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Student A, whose response typifies the specific mention of si'des *nd angles: 



They both have 3 sides. ' They both have 3 corners. 



Student B, whose response shows confusion about nomenclature as well 
acceptance of the figures^as "real" triangles: 

(In what ways ire these two figures the same?) They're both trinagles. Ah, they have 
verticles and edges. That's a big triangle, that's a small triangle. And there's distortion 
right there and distortion right here. This 1s the same as this only It's smaller. (How 
do you mean "It's the same as this only smaller"?) Okay. This Une is longer than that 
on both sides. On both of the triangles and... (Okay let's say the left, the left crooked 
Une 1s longer^than that left one and this one on that one, right. Okay. How else can 
you show n«4that they're the sum?) I dcn't know. I don't see any other way. (That's 1t. 
Okay.) 

\ 

Student C, whose response shows the attempt at comparisons: 

(In what ways are these two figures the samef) Well, they're both triangles, tjoth 3 angles, 
they bottvhave 3 sides and they' re. .. this one, I think. Hold on* It 1s the exact same* 
angle but smaller. (A, ha) The exact same thirf?*^ reduced to, I'd say, 1/4. (What's 
' smaller?) Well, there's less boxes on the inside. (Okay, it's smaller that way but the 
angles are the same?) Angles are the same. (Can you show me which angles are the same?) 
Well, that one 1s (the same as what?) Okay, that one* that one' and that one, that one. 
(It'*s Just that this triangle's bigger. Qkay. Any other ways 1n which those two figures are. 
the same?) Not that I kpow of. (Okay) 
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Pair 4 

Nomenclature •<» . 

Side, , • y 

Nineteen percent of the CSMP students referred to "sideg.' and 645 of the Non-CSMP students; 
' 6* of the CSMP students called them "lines" and so did' 145 of the Non-CSMP students. 

Angles 

One CSMP student referred to "angles"; 195 of the CSMP .students called them "lines" and so 
did.575 of 'the-. Non-CSMP students; 135 of the CSMP students called them "points" .and so did 31 
of the Non-CSMP students, while one Non-CSMP student referred to "tips". 

Shape.. . 

Seventy-five percent of 'the CSMP students referred to the shape and all but one of those 
students were unequivocal in calling the figures triangles; all the Non-CSMP students referred 
to shape but only 715 called them triangles. 

2) Students' Comparisons of Figures' Side 

Thirty-eight percent of the CSMP students referred to a comparison of figure sides, two 
of these students comparing the length of all 3 lines,- i.e., the side length of one triangle 
is 1/2 the side length of the other; only one CSMP student referred to the slope of the lines. 
Sixty- four percent of the Non-CSMP students referred to the sides and 295 of those discussed the 
similarity in terms of the same "slant" o"r "distortion" of the lines. - i 

> 

3) Students' Comparison of Figure Angle * 

Thirty 7 one percent of the CSMP students said "It was the same angle", two of those 
saying -It's smaller" one saying the "degrees" were the same, another saying "they both have 
acute' angles on all three corners"; 14: of ;the Non-GSMP students rzrerrzd to $ngle/angk 
comparisons. * ' 



4) Other -Student Consents 

One student (Non-CSMP) discussed "vertices and edges"; another used a figure/ground orientation 
r ahd said "one's farther back, and one's closer in, or one's enlarged and one's small." Three 
of the students, 1 CSMP and 2 Non-CS^tP describ 
or -"distorted" or not mathematically perfect". 



of the students, 1 CSMP and 2 Non-CS^tP described the figures as "not perfectly shaped, slanted" 
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Student P, whose comparison is limited to "straight lines" and ^he 
figure/ground Retails: 



s (And In what ways art those two figures the same?) They both have straight lines 
surrounding them, they've both got square units 1n them. Both have lines 1n color. 
Nothing else. (No other ways?) Urn-hum - are there? (Depends on how you look at 1t.) 



.: . / 

Student ft, whose comparison is at the moro general level of shapes 

(In what ways are. tfiose two figures the same?) They're both geometric shapes. (How do 
you mean by that?) Well, they're red (Yeah, but thert doesn't make thera geometric shapes, 
right? What do you mean by geometric shapes.) I guess 1s what squares aod circles' 
y and triangles. (Okay they klnda like... Any other ways in which Ifiey're we same7) 



/ 



Student S, whose comments show how students tried to articulate within- 

f 4 

figure cpmparisons: 

(In what ways are thdse two figures. both the same?) Okay, urn, ... they both have a black 
and red line, lira, they're both shapes. (What do you mean by that?) Well, like, well not 
both shapes but, well, like square, yea square could be a, shape and a triangle could be a 
shape and so they're both shapes. Uh-huh and eh. Well the points are different, Hke 
.— okay, okay. What I can say about this one has four points and they* re directly on 

the lines and this one doesn't have 4 well, ft's directly - well, the bottom part Is directly 
on the line but these two lines are not ant* these have 5 points which, this, the square has 
4 points (So that's ways that they're different but what ways are they the same) Okay, Hke 
I «sa1d they have black and red lines, they're both shapes - urn- hum. I really can't find 



anything else. 
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1) Nomenclature 
Sides 

Six percent of the CSMP students mentioned "sides M and 71 of the Non-CSHP students; 
t .2U of the Non-CSMP students re^4rred t» them as "lines". 

Angles 

» 

Thirteen percent of , the CSMP students referred to "points" and 14S of the Non-CSMP 
students referred to "corners". " : 

Shape 

Six percent of the CSMP students referred to both as "shades" as did 21 S of the 
Non-CSMP stuaents. Another Non-CSW student referred to them as "geometric figures". 

♦ 

2) Students' Comparisons of Figure Sides- ' 

- V 
One CSMP student said "the lines in both shapes are all the same length", while another 

/ 

said "both have "areas and distances (perimeters)." Of the 21 % Non-CSMP students 
discussing similarities, one Said, "The number of sides is equal to the number of corners" 
while another's similarity was that all had straight lines, and another's was that"they're 

both enclosed". , 

' 4 . ' 



V 
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Overall, neither group, CSMP or Non-CSMP, showed a high level of knowledge 
of nomenclature, of side/side similarity or angle/angle similarity. However, 
CSMP students used correct nomenclature slightly more than Non-CSMP, and were more 
sophisticated in their comparisons of sides-. Specifically; 

r 

a) Nomenclature: 

i 

The nomenclature used by students, both CSMP and non-CSMP, vyas varied. While 
some students referred to "sides" and "angles", others referred to "lines" or 
"edges" and "corners", "tips", and "points". Both groups of students also used 
terms like "square", "parallel lines" and even "triangle" but, given the 
context in which. those terms were used, it seems clear most students have only a 
hazy idea of what they mean. 

b) Side/Side and jungle/Angle Comparisons: 

1 When asked to compare the figures, a relatively low percentage of CSMP and 
non-CSMP students mentioned ways in which one, two, or more of the sides of 
the" pairs were similar; and even fewer students mentioned ways in which the .angles 

were similar. More frequently students made global comparisons, i.e., said the 

1 

two figures in -the pairwere triangles, or squares. 

k 

However, under the socratic-type questioning strategies which the interview 
situation allowed for, students were^able^to generate comparisons of line to line 
or angle to angle which they had not generated under the initial round of questioning, 

c) Other Comments: 

Several students commented that the figures, especially the triangles, were 
not "mathematically perfect" or "were distorted" which suggests to us that children 
this age carry a mental template of a. figure, like an isosceles triangle, against 
which they jnjdge the "correctness" of other triangles. 



B40 



Several children, when comparing t^e two fi gures ,' commented on what could be* 
done to one figure to make it more like another figure, i.e., adding on more 
length, slanting it upright, suggesting" that students were unable to see the 
relevant compari sons , 'but instead had to ind'uce their own less elegant solutions. 



A 



Overall, students, both CSMP and Non-CSMP, were more likely to talk about the 
. global aspects of the figures, shape or size, than they were to make wittfin- shape 
comparisons (e.g., comparing all the angles in one figure to' all the angles in the 
other). { Both groups of students appeared to have no strategy for making the 
comparisons.^ For example, no student systematically began, with a whole figure/ • 
whole figure comparison and then did part/part .side and then part/part angle 
comparisons. It follows that all students were non-exhaustive in their solutions. 
Students also varied in what they discussed from figure to fi.gure. For example, 
a student might mention area for one set^ figures and then not mention it again 
for any other set. Finally, all students seemed not to have a working knowledge 
of a) of the necessary and, sufficient conditions for naming the figures ancfb) of 
the technical meaning of terms like "parallel lines" of "angles", etc. 
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Pattern Recognita on/ GenoraH 



on 



Like the geometry task, this task was conducted only in the interview setting 
and no paper and pencil scale paralled this task. Like the geometry task, it was 
administered to find out°whether or not a pattern recognitiori/generation task wquld 
be understood by students and whether or not their responses would yield meaningful 
dfeta on pattern -recognition/generation in'general and CSMP/Non-CSMP differences in 
particular. 

Each student was interviewed' indi vidually and was presented with a sheet of 
paper on which three grids were filled in and the fourth plus a page of blank 
boxes was available. (See below for a sample of the student page.) Students were 
asked, "What would the fourth .look like? and the fifth? and the sixth? are there 
any other sixths? and any others?" until students seemed to have exhausted all 
the patterns they could generate. 
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Iths 



Student 

Generated 

Patterns 



Non-CSMP 



1 Hofi-csir * 



*cn-C$MP 



Students* Responses: 
4 ths 



5 ths 



6 CSMP 
4 Non-CSMP 



6 CSMP 
4 Hon-CSMP 



I Aon-CS*> 




1 Aon-CSMP 




b<^MP 



CSMP 



! CSMP 



t CSMP 



I CSMP 



t CSMP 
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Other Pitt-err • 
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Discussion 

» 

Overall, the patterns generated >y-both groups were similar. Four of the fi 
Non-CSMP'and six-of the eight CSMP -'students had identical fourth patterns; three 
of the five Non-CSMP and seven of the efght CSMP students had identical fifth 
patterns. But many different patterns were generated for the sixth pattern.' In 

t 

spite of these difference among students, most of these patterns were logical 
extensions of the students' previous patterns. CSMP s.tudents and Non-CSMP students 
were similar in their ability to generate additional sixth patterns; i,e./a few 
•students in both groups generated only one sixth, a few in both groups generated 
two, and a few in both groups generated three patterns. 

, ■ , ' f- 

All students understood the task and acted a's though "the pattern really 
is there". / 
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Summary of Interview Results * 
The interviews showed that the majority of students understood the task 
demands of the new scales, and, in most cases, had the mathematical knowledge to 
complete the tasks. ' While there were few marked CSMP/Non-CSMP differences, CSMP 
students showed a higher* level of sophistication in use of nomenclature and/or 
ease of solution. * i A ' 

v * 

C 

For both CSMP and N 0 n-CSMP individual students were fairly consistent in 
thel.r level of success on the MANS tasks and on the pattern recognition task. 
On the geometry task, however, there was considerable wi thin-student variation' 
jn the way the Various figures were analyzed. 
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